Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 857421 Details for
Bug 1059662
[RHSC] Status of remove-brick changed from commit-pending to unknown (?) when left untouched for a few hours
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
engine logs
engine.log (text/x-log), 8.09 MB, created by
Shruti Sampat
on 2014-01-30 10:23:45 UTC
(
hide
)
Description:
engine logs
Filename:
MIME Type:
Creator:
Shruti Sampat
Created:
2014-01-30 10:23:45 UTC
Size:
8.09 MB
patch
obsolete
>2014-01-30 03:13:04,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 505c8596 >2014-01-30 03:13:04,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 505c8596 >2014-01-30 03:13:04,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36e4d403 >2014-01-30 03:13:05,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae4444e3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5270389}, log id: 36e4d403 >2014-01-30 03:13:06,373 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:13:10,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c40ea44 >2014-01-30 03:13:10,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c40ea44 >2014-01-30 03:13:10,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4eca0697 >2014-01-30 03:13:11,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c38fb22, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f50f966}, log id: 4eca0697 >2014-01-30 03:13:11,398 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:13:16,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [23452111] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53af2f0d >2014-01-30 03:13:16,420 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:13:16,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [23452111] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 53af2f0d >2014-01-30 03:13:16,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [23452111] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 687fe2a6 >2014-01-30 03:13:16,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [23452111] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@675dc636, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@533636a8}, log id: 687fe2a6 >2014-01-30 03:13:21,436 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-45) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:13:21,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19b4d9d8 >2014-01-30 03:13:22,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 19b4d9d8 >2014-01-30 03:13:22,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ad43f56 >2014-01-30 03:13:22,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74059c9b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f55b7e1}, log id: 1ad43f56 >2014-01-30 03:13:26,456 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:13:27,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 589c35ff >2014-01-30 03:13:28,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 589c35ff >2014-01-30 03:13:28,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65e6603e >2014-01-30 03:13:28,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8545fc20, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1163036f}, log id: 65e6603e >2014-01-30 03:13:31,477 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:13:33,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c8a766 >2014-01-30 03:13:34,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7c8a766 >2014-01-30 03:13:34,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76ad9a2 >2014-01-30 03:13:34,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc5130ae, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8430089d}, log id: 76ad9a2 >2014-01-30 03:13:34,746 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) [4166d263] No up server in cluster >2014-01-30 03:13:34,747 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) [4166d263] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:13:34,750 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) [4166d263] No up server in cluster >2014-01-30 03:13:34,750 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) [4166d263] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:13:34,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 4716d22a >2014-01-30 03:13:35,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4716d22a >2014-01-30 03:13:36,496 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:13:39,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23cbf1ee >2014-01-30 03:13:39,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 23cbf1ee >2014-01-30 03:13:39,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 606f718a >2014-01-30 03:13:40,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@184b64b4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73f54420}, log id: 606f718a >2014-01-30 03:13:41,517 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:13:45,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3326e6d6 >2014-01-30 03:13:45,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3326e6d6 >2014-01-30 03:13:45,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 511c4a5a >2014-01-30 03:13:45,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28c1c1b9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@584cb4f5}, log id: 511c4a5a >2014-01-30 03:13:46,536 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:13:50,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59cc3b1a >2014-01-30 03:13:51,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 59cc3b1a >2014-01-30 03:13:51,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19b9d904 >2014-01-30 03:13:51,554 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:13:51,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79a95a0d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae538aa4}, log id: 19b9d904 >2014-01-30 03:13:56,571 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-62) [38892a17] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:13:56,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fb0805a >2014-01-30 03:13:57,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3fb0805a >2014-01-30 03:13:57,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d556e54 >2014-01-30 03:13:57,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@663da03a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fea16f3}, log id: d556e54 >2014-01-30 03:14:01,592 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:14:02,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3be514e7 >2014-01-30 03:14:03,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3be514e7 >2014-01-30 03:14:03,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25bb5cc3 >2014-01-30 03:14:03,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3893263, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3dd2e2b1}, log id: 25bb5cc3 >2014-01-30 03:14:06,612 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:14:08,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 717a18d8 >2014-01-30 03:14:08,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 717a18d8 >2014-01-30 03:14:08,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30f2e129 >2014-01-30 03:14:09,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@daf852f9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4be2328}, log id: 30f2e129 >2014-01-30 03:14:11,634 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:14:14,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1dae2c08 >2014-01-30 03:14:14,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1dae2c08 >2014-01-30 03:14:14,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1587fc25 >2014-01-30 03:14:15,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d2e690a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3912e924}, log id: 1587fc25 >2014-01-30 03:14:16,655 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:14:20,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ea648cd >2014-01-30 03:14:20,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6ea648cd >2014-01-30 03:14:20,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3264387c >2014-01-30 03:14:20,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bb0ced1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3abd585}, log id: 3264387c >2014-01-30 03:14:21,676 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:14:25,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c548a5a >2014-01-30 03:14:26,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1c548a5a >2014-01-30 03:14:26,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c3f6102 >2014-01-30 03:14:26,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0f8cc7d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9925fa}, log id: 6c3f6102 >2014-01-30 03:14:26,697 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:14:31,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c9acf51 >2014-01-30 03:14:31,717 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:14:32,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3c9acf51 >2014-01-30 03:14:32,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69fe1da3 >2014-01-30 03:14:32,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69e68a65, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bfd7b13}, log id: 69fe1da3 >2014-01-30 03:14:35,582 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-59) [4f6d8cf4] No up server in cluster >2014-01-30 03:14:35,582 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-59) [4f6d8cf4] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:14:35,585 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-59) [4f6d8cf4] No up server in cluster >2014-01-30 03:14:35,585 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-59) [4f6d8cf4] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:14:35,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) [4f6d8cf4] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43939a2c >2014-01-30 03:14:36,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) [4f6d8cf4] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 43939a2c >2014-01-30 03:14:36,734 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:14:37,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 643527d0 >2014-01-30 03:14:37,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 643527d0 >2014-01-30 03:14:37,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64d79a2f >2014-01-30 03:14:38,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53453588, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ace06c5}, log id: 64d79a2f >2014-01-30 03:14:38,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 2bf074e6 >2014-01-30 03:14:38,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@25f4eb02, log id: 2bf074e6 >2014-01-30 03:14:38,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 7270e3c5 >2014-01-30 03:14:39,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3be18503, log id: 7270e3c5 >2014-01-30 03:14:41,756 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:14:43,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3544a8d >2014-01-30 03:14:43,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3544a8d >2014-01-30 03:14:43,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3bb561a7 >2014-01-30 03:14:44,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23e2d4c8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e922a554}, log id: 3bb561a7 >2014-01-30 03:14:46,775 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:14:49,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b147a37 >2014-01-30 03:14:49,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6b147a37 >2014-01-30 03:14:49,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14b31b44 >2014-01-30 03:14:49,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f36d41c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6217f927}, log id: 14b31b44 >2014-01-30 03:14:51,798 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-20) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:14:54,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [273f6e94] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14fff871 >2014-01-30 03:14:55,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [273f6e94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 14fff871 >2014-01-30 03:14:55,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [273f6e94] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 304a4c2f >2014-01-30 03:14:55,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [273f6e94] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd8fa903, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f500c72b}, log id: 304a4c2f >2014-01-30 03:14:56,821 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:15:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-34) [3172b561] Autorecovering 1 hosts >2014-01-30 03:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-34) [3172b561] Autorecovering hosts id: 80dfb2ba-85ca-41d0-9af5-8468c89e2354, name : host1 >2014-01-30 03:15:00,012 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-34) [27177145] Lock Acquired to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 03:15:00,012 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-34) [27177145] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:15:00,012 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-34) [27177145] Before acquiring lock in order to prevent monitoring for host host1 from data-center Default >2014-01-30 03:15:00,012 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-34) [27177145] Lock acquired, from now a monitoring of host will be skipped for host host1 from data-center Default >2014-01-30 03:15:00,019 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-34) [27177145] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=Unassigned, nonOperationalReason=NONE), log id: 5f55a23b >2014-01-30 03:15:00,025 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-34) [27177145] FINISH, SetVdsStatusVDSCommand, log id: 5f55a23b >2014-01-30 03:15:00,027 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-34) [27177145] START, ActivateVdsVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 37327d7e >2014-01-30 03:15:00,096 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-34) [27177145] START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, vds=Host[host1]), log id: 3c7c6555 >2014-01-30 03:15:00,111 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-34) [27177145] FINISH, GetHardwareInfoVDSCommand, log id: 3c7c6555 >2014-01-30 03:15:00,146 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-34) [5a20834b] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:15:00,149 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-34) [5a20834b] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=NonOperational, nonOperationalReason=NETWORK_UNREACHABLE), log id: 21134d6f >2014-01-30 03:15:00,155 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-34) [5a20834b] FINISH, SetVdsStatusVDSCommand, log id: 21134d6f >2014-01-30 03:15:00,161 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-34) [5a20834b] Host host1 is set to Non-Operational, it is missing the following networks: ovirtmgmt >2014-01-30 03:15:00,173 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-34) [5a20834b] Correlation ID: 5a20834b, Job ID: 26a69189-cb14-4bf7-8e46-bcc09a1e7c99, Call Stack: null, Custom Event ID: -1, Message: Host host1 does not comply with the cluster test_1 networks, the following networks are missing on host: 'ovirtmgmt' >2014-01-30 03:15:00,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [5a20834b] START, GlusterServersListVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 14ab0d00 >2014-01-30 03:15:00,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [5a20834b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.220:CONNECTED, 10.70.37.158:CONNECTED], log id: 14ab0d00 >2014-01-30 03:15:00,681 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:15:00,683 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, ActivateVdsVDSCommand, return: Host[host1], log id: 37327d7e >2014-01-30 03:15:00,704 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] Activate finished. Lock released. Monitoring can run now for host host1 from data-center Default >2014-01-30 03:15:00,706 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] Lock freed to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 03:15:00,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 327eb2c1 >2014-01-30 03:15:01,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 327eb2c1 >2014-01-30 03:15:01,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: abfdc8c >2014-01-30 03:15:01,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76f557d7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7c9d215}, log id: abfdc8c >2014-01-30 03:15:01,839 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:15:06,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76554876 >2014-01-30 03:15:06,860 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:15:07,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 76554876 >2014-01-30 03:15:07,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2259db45 >2014-01-30 03:15:07,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d4c0427, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efea726b}, log id: 2259db45 >2014-01-30 03:15:11,883 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:15:12,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 750a7451 >2014-01-30 03:15:12,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 750a7451 >2014-01-30 03:15:12,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4abfc7a3 >2014-01-30 03:15:13,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d004a99, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7bf5403}, log id: 4abfc7a3 >2014-01-30 03:15:16,902 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:15:18,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a829661 >2014-01-30 03:15:18,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7a829661 >2014-01-30 03:15:18,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1abdba5b >2014-01-30 03:15:19,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ed2257c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2121e561}, log id: 1abdba5b >2014-01-30 03:15:21,924 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:15:24,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6240950a >2014-01-30 03:15:24,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6240950a >2014-01-30 03:15:24,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1fec4890 >2014-01-30 03:15:24,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ff74240, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc805e07}, log id: 1fec4890 >2014-01-30 03:15:26,945 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-98) [3cbffe96] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:15:29,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2742f19c >2014-01-30 03:15:30,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2742f19c >2014-01-30 03:15:30,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 751ae31b >2014-01-30 03:15:30,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f939a21, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@891bb756}, log id: 751ae31b >2014-01-30 03:15:31,964 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:15:35,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4237ee18] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3acf73ee >2014-01-30 03:15:36,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4237ee18] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3acf73ee >2014-01-30 03:15:36,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4237ee18] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 62ac4dfb >2014-01-30 03:15:36,400 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-23) [2517ed6c] No up server in cluster >2014-01-30 03:15:36,400 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:15:36,402 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-23) [2517ed6c] No up server in cluster >2014-01-30 03:15:36,402 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:15:36,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 39cdf100 >2014-01-30 03:15:36,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4237ee18] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86f924c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80288923}, log id: 62ac4dfb >2014-01-30 03:15:36,987 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-13) [273f6e94] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:15:37,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 39cdf100 >2014-01-30 03:15:41,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c420412 >2014-01-30 03:15:41,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: c420412 >2014-01-30 03:15:41,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14173425 >2014-01-30 03:15:42,006 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:15:42,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12952050, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37127e6}, log id: 14173425 >2014-01-30 03:15:47,026 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:15:47,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f1fe3d >2014-01-30 03:15:47,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: f1fe3d >2014-01-30 03:15:47,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4525bfec >2014-01-30 03:15:48,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90d8980, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dbce371d}, log id: 4525bfec >2014-01-30 03:15:52,044 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:15:53,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [38892a17] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: dabf5d3 >2014-01-30 03:15:53,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [38892a17] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: dabf5d3 >2014-01-30 03:15:53,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [38892a17] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e296589 >2014-01-30 03:15:53,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [38892a17] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a05a46e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe432eb1}, log id: 5e296589 >2014-01-30 03:15:57,065 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:15:58,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69a4a824 >2014-01-30 03:15:59,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 69a4a824 >2014-01-30 03:15:59,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7593ed53 >2014-01-30 03:15:59,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b24cd4d2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ea3aeaf}, log id: 7593ed53 >2014-01-30 03:16:02,087 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:16:04,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35ee3d03 >2014-01-30 03:16:05,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 35ee3d03 >2014-01-30 03:16:05,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b8d08d0 >2014-01-30 03:16:05,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@684a1274, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b3de274}, log id: 2b8d08d0 >2014-01-30 03:16:07,106 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:16:10,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2868f52 >2014-01-30 03:16:11,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2868f52 >2014-01-30 03:16:11,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77fa702d >2014-01-30 03:16:11,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@223f8337, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bae13b7}, log id: 77fa702d >2014-01-30 03:16:12,128 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-20) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:16:16,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13c36be1 >2014-01-30 03:16:16,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 13c36be1 >2014-01-30 03:16:16,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ca56d7c >2014-01-30 03:16:17,151 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:16:17,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88d3a7bb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@233a4ec7}, log id: 4ca56d7c >2014-01-30 03:16:22,171 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:16:22,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15d1ba80 >2014-01-30 03:16:22,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 15d1ba80 >2014-01-30 03:16:22,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4afc70 >2014-01-30 03:16:23,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@456bace, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8c43089}, log id: 4afc70 >2014-01-30 03:16:27,188 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:16:28,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17cb41f4 >2014-01-30 03:16:28,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 17cb41f4 >2014-01-30 03:16:28,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2cd35261 >2014-01-30 03:16:28,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d472c178, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b992259}, log id: 2cd35261 >2014-01-30 03:16:32,211 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:16:33,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ab0a4 >2014-01-30 03:16:34,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: ab0a4 >2014-01-30 03:16:34,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e43e315 >2014-01-30 03:16:34,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b227521, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@433e5c13}, log id: 2e43e315 >2014-01-30 03:16:37,233 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-28) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:16:37,236 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2014-01-30 03:16:37,236 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:16:37,239 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2014-01-30 03:16:37,240 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:16:37,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 221220c1 >2014-01-30 03:16:38,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 221220c1 >2014-01-30 03:16:39,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 381881b8 >2014-01-30 03:16:40,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 381881b8 >2014-01-30 03:16:40,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b829e1e >2014-01-30 03:16:40,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8589735b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@208fab3a}, log id: 6b829e1e >2014-01-30 03:16:42,253 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:16:45,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30a8499 >2014-01-30 03:16:46,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 30a8499 >2014-01-30 03:16:46,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a1ede6c >2014-01-30 03:16:46,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25bd97c1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2e3d309}, log id: 4a1ede6c >2014-01-30 03:16:47,274 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:16:51,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7397a976 >2014-01-30 03:16:51,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7397a976 >2014-01-30 03:16:51,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5af7e837 >2014-01-30 03:16:52,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec6cae31, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb442a58}, log id: 5af7e837 >2014-01-30 03:16:52,295 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:16:57,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17644126 >2014-01-30 03:16:57,318 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-13) [273f6e94] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:16:57,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 17644126 >2014-01-30 03:16:57,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: eb72f54 >2014-01-30 03:16:57,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dca3dc96, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@594cee6}, log id: eb72f54 >2014-01-30 03:17:02,339 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-39) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:17:02,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25c07a3b >2014-01-30 03:17:03,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 25c07a3b >2014-01-30 03:17:03,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44d800e3 >2014-01-30 03:17:03,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c227b85, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27860ba7}, log id: 44d800e3 >2014-01-30 03:17:07,359 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:17:08,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 371db7a2 >2014-01-30 03:17:09,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 371db7a2 >2014-01-30 03:17:09,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79b292eb >2014-01-30 03:17:09,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2bbcc466, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7153e0b6}, log id: 79b292eb >2014-01-30 03:17:12,382 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:17:14,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5dd5c35c >2014-01-30 03:17:15,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5dd5c35c >2014-01-30 03:17:15,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29a247a7 >2014-01-30 03:17:15,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee38010c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a7dfa15}, log id: 29a247a7 >2014-01-30 03:17:17,403 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-45) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:17:20,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35830cbc >2014-01-30 03:17:20,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 35830cbc >2014-01-30 03:17:20,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69688458 >2014-01-30 03:17:21,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d3da412, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ad3fe97}, log id: 69688458 >2014-01-30 03:17:22,424 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:17:26,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d9d0635 >2014-01-30 03:17:26,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3d9d0635 >2014-01-30 03:17:26,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51fa78bb >2014-01-30 03:17:26,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@339c6eb9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2bb0b549}, log id: 51fa78bb >2014-01-30 03:17:27,444 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:17:32,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6fa875db >2014-01-30 03:17:32,463 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:17:32,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6fa875db >2014-01-30 03:17:32,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3489456f >2014-01-30 03:17:32,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a30dfd8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7af02cba}, log id: 3489456f >2014-01-30 03:17:37,477 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:17:37,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 73d46c48 >2014-01-30 03:17:38,052 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-81) [5c437990] No up server in cluster >2014-01-30 03:17:38,052 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-81) [5c437990] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:17:38,055 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-81) [5c437990] No up server in cluster >2014-01-30 03:17:38,056 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-81) [5c437990] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:17:38,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: e3064e1 >2014-01-30 03:17:38,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 73d46c48 >2014-01-30 03:17:38,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c965d7 >2014-01-30 03:17:38,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf5a05e4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2e585cd}, log id: 7c965d7 >2014-01-30 03:17:38,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: e3064e1 >2014-01-30 03:17:42,498 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:17:43,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 28074679 >2014-01-30 03:17:44,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 28074679 >2014-01-30 03:17:44,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59418662 >2014-01-30 03:17:44,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdefa057, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@173ac4f9}, log id: 59418662 >2014-01-30 03:17:47,517 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:17:49,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2aedb64e >2014-01-30 03:17:49,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2aedb64e >2014-01-30 03:17:49,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5db33c14 >2014-01-30 03:17:50,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f912f76, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19d809f7}, log id: 5db33c14 >2014-01-30 03:17:52,538 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) [4f6d8cf4] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:17:55,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4191c12a >2014-01-30 03:17:55,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4191c12a >2014-01-30 03:17:55,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a459949 >2014-01-30 03:17:56,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@502b2366, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fcc44bd}, log id: 1a459949 >2014-01-30 03:17:57,560 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-68) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:18:01,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a67f622 >2014-01-30 03:18:01,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5a67f622 >2014-01-30 03:18:01,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 782d7540 >2014-01-30 03:18:01,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@459ecf74, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e6022d1}, log id: 782d7540 >2014-01-30 03:18:02,577 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:18:06,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58c571e0 >2014-01-30 03:18:07,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 58c571e0 >2014-01-30 03:18:07,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 62baaeaf >2014-01-30 03:18:07,600 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:18:07,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e979322, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54b73091}, log id: 62baaeaf >2014-01-30 03:18:12,620 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:18:12,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2bcb6d6 >2014-01-30 03:18:13,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2bcb6d6 >2014-01-30 03:18:13,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a6fda79 >2014-01-30 03:18:13,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0f8fb39, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4b711fa}, log id: 3a6fda79 >2014-01-30 03:18:17,641 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:18:18,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b690d01 >2014-01-30 03:18:19,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: b690d01 >2014-01-30 03:18:19,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44995810 >2014-01-30 03:18:19,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38123d9f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92c96c43}, log id: 44995810 >2014-01-30 03:18:22,660 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-39) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:18:24,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41c28ed8 >2014-01-30 03:18:24,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 41c28ed8 >2014-01-30 03:18:24,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f18d270 >2014-01-30 03:18:25,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fee24bba, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3350b43e}, log id: 5f18d270 >2014-01-30 03:18:27,681 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:18:30,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14a08618 >2014-01-30 03:18:30,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 14a08618 >2014-01-30 03:18:30,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c9c5ab7 >2014-01-30 03:18:31,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36dceabb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21c333ab}, log id: 3c9c5ab7 >2014-01-30 03:18:32,703 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:18:36,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3011de81 >2014-01-30 03:18:36,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3011de81 >2014-01-30 03:18:36,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3585d89f >2014-01-30 03:18:36,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd8e3530, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9167cc73}, log id: 3585d89f >2014-01-30 03:18:37,725 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-28) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:18:38,835 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-71) [1ac2212e] No up server in cluster >2014-01-30 03:18:38,835 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-71) [1ac2212e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:18:38,839 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-71) [1ac2212e] No up server in cluster >2014-01-30 03:18:38,839 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-71) [1ac2212e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:18:38,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 39e1221b >2014-01-30 03:18:39,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 39e1221b >2014-01-30 03:18:41,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43220496 >2014-01-30 03:18:42,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43220496 >2014-01-30 03:18:42,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 725586ef >2014-01-30 03:18:42,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b78a46ae, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8626b141}, log id: 725586ef >2014-01-30 03:18:42,745 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:18:47,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7bd28624 >2014-01-30 03:18:47,764 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:18:48,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7bd28624 >2014-01-30 03:18:48,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d0d3553 >2014-01-30 03:18:48,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24e1c3fb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa58bfcc}, log id: d0d3553 >2014-01-30 03:18:52,784 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:18:53,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a66351e >2014-01-30 03:18:54,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3a66351e >2014-01-30 03:18:54,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29b74e09 >2014-01-30 03:18:54,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3da01b26, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@965b76b0}, log id: 29b74e09 >2014-01-30 03:18:57,801 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:18:59,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ab8be64 >2014-01-30 03:18:59,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6ab8be64 >2014-01-30 03:18:59,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24c0175c >2014-01-30 03:19:00,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94b32198, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f81e9424}, log id: 24c0175c >2014-01-30 03:19:02,836 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:19:05,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1085a112 >2014-01-30 03:19:05,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1085a112 >2014-01-30 03:19:05,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5056a5f1 >2014-01-30 03:19:05,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a45c4908, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd8bb2ad}, log id: 5056a5f1 >2014-01-30 03:19:07,854 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:19:11,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30ee389b >2014-01-30 03:19:11,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 30ee389b >2014-01-30 03:19:11,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d16842f >2014-01-30 03:19:11,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@809ae849, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6e82c94}, log id: 4d16842f >2014-01-30 03:19:12,877 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-53) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:19:16,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7254fa7e >2014-01-30 03:19:17,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7254fa7e >2014-01-30 03:19:17,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77aeea4f >2014-01-30 03:19:17,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abfb476e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9056a7df}, log id: 77aeea4f >2014-01-30 03:19:17,899 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-68) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:19:22,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c597aee >2014-01-30 03:19:22,920 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:19:23,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c597aee >2014-01-30 03:19:23,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d1d9e36 >2014-01-30 03:19:23,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c0ffb14, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7691f7d7}, log id: 1d1d9e36 >2014-01-30 03:19:27,939 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:19:28,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21a72a5d >2014-01-30 03:19:28,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 21a72a5d >2014-01-30 03:19:28,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59b2352e >2014-01-30 03:19:29,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c57a1f8e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2d5dc49}, log id: 59b2352e >2014-01-30 03:19:32,958 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-40) [4237ee18] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:19:34,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d768291 >2014-01-30 03:19:34,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5d768291 >2014-01-30 03:19:34,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 148a3db9 >2014-01-30 03:19:35,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d1214ff, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0a77eeb}, log id: 148a3db9 >2014-01-30 03:19:37,979 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:19:39,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 40988db7 >2014-01-30 03:19:39,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@352400b6, log id: 40988db7 >2014-01-30 03:19:39,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 4eaac7fb >2014-01-30 03:19:39,661 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-65) [227486be] No up server in cluster >2014-01-30 03:19:39,661 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-65) [227486be] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:19:39,662 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-65) [227486be] No up server in cluster >2014-01-30 03:19:39,663 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-65) [227486be] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:19:39,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 61012f65 >2014-01-30 03:19:39,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2d30ddb5, log id: 4eaac7fb >2014-01-30 03:19:40,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 438d4e7c >2014-01-30 03:19:40,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 61012f65 >2014-01-30 03:19:40,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 438d4e7c >2014-01-30 03:19:40,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20ea4818 >2014-01-30 03:19:40,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48558ba0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f1a1961}, log id: 20ea4818 >2014-01-30 03:19:43,001 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:19:45,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50abdd65 >2014-01-30 03:19:46,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 50abdd65 >2014-01-30 03:19:46,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68837264 >2014-01-30 03:19:46,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98701103, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7dc19eb1}, log id: 68837264 >2014-01-30 03:19:48,019 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:19:51,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7bcbb465 >2014-01-30 03:19:52,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7bcbb465 >2014-01-30 03:19:52,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3eb4d525 >2014-01-30 03:19:52,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cf6b192, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69fb3b41}, log id: 3eb4d525 >2014-01-30 03:19:53,039 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-53) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:19:57,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78af6d63 >2014-01-30 03:19:58,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 78af6d63 >2014-01-30 03:19:58,058 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:19:58,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13a6b84 >2014-01-30 03:19:58,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e18fc256, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b34848cb}, log id: 13a6b84 >2014-01-30 03:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [3cbffe96] Autorecovering 1 hosts >2014-01-30 03:20:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [3cbffe96] Autorecovering hosts id: 80dfb2ba-85ca-41d0-9af5-8468c89e2354, name : host1 >2014-01-30 03:20:00,012 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-98) [2d3e1b1a] Lock Acquired to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 03:20:00,012 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-98) [2d3e1b1a] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:20:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-98) [2d3e1b1a] Before acquiring lock in order to prevent monitoring for host host1 from data-center Default >2014-01-30 03:20:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-98) [2d3e1b1a] Lock acquired, from now a monitoring of host will be skipped for host host1 from data-center Default >2014-01-30 03:20:00,020 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-98) [2d3e1b1a] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=Unassigned, nonOperationalReason=NONE), log id: 7dd52566 >2014-01-30 03:20:00,026 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-98) [2d3e1b1a] FINISH, SetVdsStatusVDSCommand, log id: 7dd52566 >2014-01-30 03:20:00,028 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-98) [2d3e1b1a] START, ActivateVdsVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 2a73dc6 >2014-01-30 03:20:00,089 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-98) [2d3e1b1a] START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, vds=Host[host1]), log id: 1602bb1e >2014-01-30 03:20:00,104 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-98) [2d3e1b1a] FINISH, GetHardwareInfoVDSCommand, log id: 1602bb1e >2014-01-30 03:20:00,137 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-98) [24702a51] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:20:00,139 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-98) [24702a51] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=NonOperational, nonOperationalReason=NETWORK_UNREACHABLE), log id: 312de9f0 >2014-01-30 03:20:00,144 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-98) [24702a51] FINISH, SetVdsStatusVDSCommand, log id: 312de9f0 >2014-01-30 03:20:00,150 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-98) [24702a51] Host host1 is set to Non-Operational, it is missing the following networks: ovirtmgmt >2014-01-30 03:20:00,161 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-98) [24702a51] Correlation ID: 24702a51, Job ID: 37d9d66f-d273-41f4-bcf8-1bcd5e226109, Call Stack: null, Custom Event ID: -1, Message: Host host1 does not comply with the cluster test_1 networks, the following networks are missing on host: 'ovirtmgmt' >2014-01-30 03:20:00,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [24702a51] START, GlusterServersListVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 4ae812de >2014-01-30 03:20:00,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [24702a51] FINISH, GlusterServersListVDSCommand, return: [10.70.37.220:CONNECTED, 10.70.37.158:CONNECTED], log id: 4ae812de >2014-01-30 03:20:00,673 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-98) [42330db] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:20:00,674 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-98) [42330db] FINISH, ActivateVdsVDSCommand, return: Host[host1], log id: 2a73dc6 >2014-01-30 03:20:00,694 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-98) [42330db] Activate finished. Lock released. Monitoring can run now for host host1 from data-center Default >2014-01-30 03:20:00,696 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-98) [42330db] Lock freed to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 03:20:03,078 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:20:03,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 195609be >2014-01-30 03:20:03,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 195609be >2014-01-30 03:20:03,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ca10529 >2014-01-30 03:20:04,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96c5bad0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8398edf}, log id: 2ca10529 >2014-01-30 03:20:08,099 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-20) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:20:09,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 523141a >2014-01-30 03:20:09,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 523141a >2014-01-30 03:20:09,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f96c221 >2014-01-30 03:20:10,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@409cfa77, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8382c42}, log id: 5f96c221 >2014-01-30 03:20:13,126 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:20:15,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1da2928c >2014-01-30 03:20:15,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1da2928c >2014-01-30 03:20:15,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25e876a4 >2014-01-30 03:20:15,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be228521, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@435dee0}, log id: 25e876a4 >2014-01-30 03:20:18,146 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:20:20,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25bdbc1 >2014-01-30 03:20:21,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 25bdbc1 >2014-01-30 03:20:21,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44ef5f80 >2014-01-30 03:20:21,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29395490, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81c9b872}, log id: 44ef5f80 >2014-01-30 03:20:23,167 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:20:26,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a80cf72 >2014-01-30 03:20:27,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a80cf72 >2014-01-30 03:20:27,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 486b2332 >2014-01-30 03:20:27,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@966b710a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fae5fb12}, log id: 486b2332 >2014-01-30 03:20:28,188 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-63) [23452111] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:20:32,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 80e1b7f >2014-01-30 03:20:33,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 80e1b7f >2014-01-30 03:20:33,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b8c41a8 >2014-01-30 03:20:33,208 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:20:33,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c425445a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@689b9e10}, log id: 6b8c41a8 >2014-01-30 03:20:38,228 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:20:38,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b703e8a >2014-01-30 03:20:38,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7b703e8a >2014-01-30 03:20:38,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16759aae >2014-01-30 03:20:39,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c14612c8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d3b84e2}, log id: 16759aae >2014-01-30 03:20:40,446 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) [992a9f] No up server in cluster >2014-01-30 03:20:40,446 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) [992a9f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:20:40,450 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) [992a9f] No up server in cluster >2014-01-30 03:20:40,450 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) [992a9f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:20:40,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 52e8bc96 >2014-01-30 03:20:41,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 52e8bc96 >2014-01-30 03:20:43,246 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:20:44,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2808684c >2014-01-30 03:20:44,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2808684c >2014-01-30 03:20:44,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66cdd66c >2014-01-30 03:20:44,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da76ecbb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e4f6da6}, log id: 66cdd66c >2014-01-30 03:20:48,266 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-20) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:20:50,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6474970b >2014-01-30 03:20:50,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6474970b >2014-01-30 03:20:50,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72ce5638 >2014-01-30 03:20:50,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@238e9bda, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffc47974}, log id: 72ce5638 >2014-01-30 03:20:53,288 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:20:55,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12430f32 >2014-01-30 03:20:56,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 12430f32 >2014-01-30 03:20:56,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ef686c4 >2014-01-30 03:20:56,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1cda54d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41c03ceb}, log id: 6ef686c4 >2014-01-30 03:20:58,306 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:21:01,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43ec7554 >2014-01-30 03:21:02,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43ec7554 >2014-01-30 03:21:02,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3125d70a >2014-01-30 03:21:02,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24bbb911, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbda01e6}, log id: 3125d70a >2014-01-30 03:21:03,324 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:21:07,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15a24617 >2014-01-30 03:21:07,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 15a24617 >2014-01-30 03:21:07,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: df1014d >2014-01-30 03:21:08,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6868d2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c8bdaa}, log id: df1014d >2014-01-30 03:21:08,343 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:21:13,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 184ff09 >2014-01-30 03:21:13,365 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:21:13,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 184ff09 >2014-01-30 03:21:13,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7da9fca4 >2014-01-30 03:21:14,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16cc5d18, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a285e50}, log id: 7da9fca4 >2014-01-30 03:21:18,380 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:21:19,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11ce7c52 >2014-01-30 03:21:19,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 11ce7c52 >2014-01-30 03:21:19,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 225e572f >2014-01-30 03:21:19,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a51197a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da3ad3cc}, log id: 225e572f >2014-01-30 03:21:23,404 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:21:24,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37af40b6 >2014-01-30 03:21:25,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 37af40b6 >2014-01-30 03:21:25,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29bf0f13 >2014-01-30 03:21:25,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fabe51ae, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b8bece6}, log id: 29bf0f13 >2014-01-30 03:21:28,426 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:21:30,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3371f4f2 >2014-01-30 03:21:31,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3371f4f2 >2014-01-30 03:21:31,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ced56fb >2014-01-30 03:21:31,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d9fc9c3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75dbefcf}, log id: 6ced56fb >2014-01-30 03:21:33,446 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:21:36,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 217a9114 >2014-01-30 03:21:36,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 217a9114 >2014-01-30 03:21:36,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8f055ab >2014-01-30 03:21:37,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7edae26b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69c6ea73}, log id: 8f055ab >2014-01-30 03:21:38,468 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:21:41,250 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-97) [717bad08] No up server in cluster >2014-01-30 03:21:41,250 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-97) [717bad08] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:21:41,253 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-97) [717bad08] No up server in cluster >2014-01-30 03:21:41,253 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-97) [717bad08] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:21:41,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: e48d9ec >2014-01-30 03:21:42,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: e48d9ec >2014-01-30 03:21:42,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e1a9d12 >2014-01-30 03:21:42,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: e1a9d12 >2014-01-30 03:21:42,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 47676a11 >2014-01-30 03:21:43,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@162b64c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@317ac886}, log id: 47676a11 >2014-01-30 03:21:43,488 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:21:48,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a4403ec >2014-01-30 03:21:48,511 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) [4f6d8cf4] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:21:48,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a4403ec >2014-01-30 03:21:48,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ab43ab7 >2014-01-30 03:21:48,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fee01324, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72a0ed46}, log id: ab43ab7 >2014-01-30 03:21:53,525 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:21:53,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26f8e218 >2014-01-30 03:21:54,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 26f8e218 >2014-01-30 03:21:54,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6afa0940 >2014-01-30 03:21:54,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@751bc336, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e143d3c}, log id: 6afa0940 >2014-01-30 03:21:58,546 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-98) [42330db] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:21:59,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e6094e0 >2014-01-30 03:22:00,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6e6094e0 >2014-01-30 03:22:00,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e9cee66 >2014-01-30 03:22:00,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b96995d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18b99d17}, log id: 6e9cee66 >2014-01-30 03:22:03,569 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:22:05,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c9345bf >2014-01-30 03:22:06,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1c9345bf >2014-01-30 03:22:06,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6cb3b0a1 >2014-01-30 03:22:06,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eed8c581, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9c6b9af}, log id: 6cb3b0a1 >2014-01-30 03:22:08,589 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-20) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:22:11,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58009413 >2014-01-30 03:22:11,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 58009413 >2014-01-30 03:22:11,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 93bec75 >2014-01-30 03:22:12,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3239a04, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34c21789}, log id: 93bec75 >2014-01-30 03:22:13,606 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:22:17,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f49cfa5 >2014-01-30 03:22:17,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4f49cfa5 >2014-01-30 03:22:17,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68be8c97 >2014-01-30 03:22:18,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4eed9e04, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32cf7c91}, log id: 68be8c97 >2014-01-30 03:22:18,627 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:22:23,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1251d2e9 >2014-01-30 03:22:23,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1251d2e9 >2014-01-30 03:22:23,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 124ac0fa >2014-01-30 03:22:23,646 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:22:23,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da95adbc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82be7fb2}, log id: 124ac0fa >2014-01-30 03:22:28,664 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:22:28,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3168e05e >2014-01-30 03:22:29,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3168e05e >2014-01-30 03:22:29,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23124484 >2014-01-30 03:22:29,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3420b9e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ae24bda}, log id: 23124484 >2014-01-30 03:22:33,684 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:22:34,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66478641 >2014-01-30 03:22:35,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 66478641 >2014-01-30 03:22:35,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ec38ef1 >2014-01-30 03:22:35,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac534d35, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35fdf151}, log id: 1ec38ef1 >2014-01-30 03:22:38,708 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-98) [42330db] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:22:40,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1217f34 >2014-01-30 03:22:41,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1217f34 >2014-01-30 03:22:41,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15132245 >2014-01-30 03:22:41,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21f2f61b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80b3aa2b}, log id: 15132245 >2014-01-30 03:22:42,057 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] No up server in cluster >2014-01-30 03:22:42,058 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:22:42,061 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] No up server in cluster >2014-01-30 03:22:42,061 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:22:42,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 18574fe1 >2014-01-30 03:22:42,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 18574fe1 >2014-01-30 03:22:43,729 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:22:46,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4237ee18] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ad7c1d9 >2014-01-30 03:22:46,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4237ee18] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1ad7c1d9 >2014-01-30 03:22:46,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4237ee18] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d3c8718 >2014-01-30 03:22:47,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4237ee18] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1cebb2b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c2ed689}, log id: 3d3c8718 >2014-01-30 03:22:48,748 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:22:52,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f64f203 >2014-01-30 03:22:52,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f64f203 >2014-01-30 03:22:52,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24bacd51 >2014-01-30 03:22:52,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4318d15, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5ec6d97}, log id: 24bacd51 >2014-01-30 03:22:53,773 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:22:58,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5575a13 >2014-01-30 03:22:58,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5575a13 >2014-01-30 03:22:58,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 93aaa9d >2014-01-30 03:22:58,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fb70d4c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@224f6d03}, log id: 93aaa9d >2014-01-30 03:22:58,797 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:23:03,818 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:23:03,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b71b9b8 >2014-01-30 03:23:04,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: b71b9b8 >2014-01-30 03:23:04,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ce985a9 >2014-01-30 03:23:04,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe7cad43, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a572267}, log id: 4ce985a9 >2014-01-30 03:23:08,840 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-51) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:23:09,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6871d90b >2014-01-30 03:23:10,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6871d90b >2014-01-30 03:23:10,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51cbbea6 >2014-01-30 03:23:10,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e56485b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4446211}, log id: 51cbbea6 >2014-01-30 03:23:13,865 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:23:15,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4dcd47fd >2014-01-30 03:23:15,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4dcd47fd >2014-01-30 03:23:15,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 136febfb >2014-01-30 03:23:16,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc82eda0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cafc5be}, log id: 136febfb >2014-01-30 03:23:18,886 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:23:21,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40d044dd >2014-01-30 03:23:21,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 40d044dd >2014-01-30 03:23:21,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56dc81e2 >2014-01-30 03:23:22,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8531b69, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d89100d}, log id: 56dc81e2 >2014-01-30 03:23:23,905 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:23:27,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a6837d0 >2014-01-30 03:23:27,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7a6837d0 >2014-01-30 03:23:27,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44580a58 >2014-01-30 03:23:27,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39d25ce9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b1914b1}, log id: 44580a58 >2014-01-30 03:23:28,927 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-13) [273f6e94] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:23:32,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 287f615b >2014-01-30 03:23:33,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 287f615b >2014-01-30 03:23:33,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31773593 >2014-01-30 03:23:33,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f0e362, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ecbdc73}, log id: 31773593 >2014-01-30 03:23:33,947 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:23:38,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a2bcadf >2014-01-30 03:23:38,970 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:23:39,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5a2bcadf >2014-01-30 03:23:39,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6dcf843c >2014-01-30 03:23:39,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2170cc7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebd06597}, log id: 6dcf843c >2014-01-30 03:23:42,900 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] No up server in cluster >2014-01-30 03:23:42,900 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:23:42,903 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] No up server in cluster >2014-01-30 03:23:42,903 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:23:42,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 50f24935 >2014-01-30 03:23:43,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 50f24935 >2014-01-30 03:23:43,989 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:23:44,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2501956b >2014-01-30 03:23:45,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2501956b >2014-01-30 03:23:45,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42df6106 >2014-01-30 03:23:45,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6119a251, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f55e1b30}, log id: 42df6106 >2014-01-30 03:23:49,009 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-51) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:23:50,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11c26f00 >2014-01-30 03:23:50,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 11c26f00 >2014-01-30 03:23:50,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d5e7a8c >2014-01-30 03:23:51,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5980198f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7cc33fae}, log id: 3d5e7a8c >2014-01-30 03:23:54,029 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-69) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:23:56,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 608a23ec >2014-01-30 03:23:56,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 608a23ec >2014-01-30 03:23:56,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b52da64 >2014-01-30 03:23:56,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@478d1337, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b0bbde0}, log id: 5b52da64 >2014-01-30 03:23:59,047 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:24:00,297 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-5) Running command: LoginAdminUserCommand internal: false. >2014-01-30 03:24:00,308 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-5) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-01-30 03:24:00,360 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-3) Running command: LoginUserCommand internal: false. >2014-01-30 03:24:00,377 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-01-30 03:24:01,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24e1ea05 >2014-01-30 03:24:02,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 24e1ea05 >2014-01-30 03:24:02,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66bf8697 >2014-01-30 03:24:02,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3717e1fa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ddef429}, log id: 66bf8697 >2014-01-30 03:24:04,067 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:24:07,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a036305 >2014-01-30 03:24:08,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5a036305 >2014-01-30 03:24:08,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 589763f3 >2014-01-30 03:24:08,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d549dd8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@969a3c43}, log id: 589763f3 >2014-01-30 03:24:09,093 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:24:13,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c79dbf3 >2014-01-30 03:24:14,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5c79dbf3 >2014-01-30 03:24:14,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ef412e8 >2014-01-30 03:24:14,114 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:24:14,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c3fbf5b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac6b024}, log id: 7ef412e8 >2014-01-30 03:24:19,132 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:24:19,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1fdf8412 >2014-01-30 03:24:19,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1fdf8412 >2014-01-30 03:24:19,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 63bcd90d >2014-01-30 03:24:20,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4807c5a3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a83892f}, log id: 63bcd90d >2014-01-30 03:24:24,154 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:24:25,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b9eb8c1 >2014-01-30 03:24:25,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: b9eb8c1 >2014-01-30 03:24:25,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11c27d3a >2014-01-30 03:24:26,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b581f6ea, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bce73ec5}, log id: 11c27d3a >2014-01-30 03:24:29,175 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-4) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:24:31,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 430beead >2014-01-30 03:24:31,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 430beead >2014-01-30 03:24:31,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33a319fa >2014-01-30 03:24:31,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a2d7643, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2a1d9c4}, log id: 33a319fa >2014-01-30 03:24:34,193 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:24:36,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c1c3d55 >2014-01-30 03:24:37,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1c1c3d55 >2014-01-30 03:24:37,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c950091 >2014-01-30 03:24:37,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@254c31f8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e14ad23f}, log id: 6c950091 >2014-01-30 03:24:39,212 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:24:39,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 4fbbc062 >2014-01-30 03:24:40,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4567eee0, log id: 4fbbc062 >2014-01-30 03:24:40,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 2a73d7b9 >2014-01-30 03:24:40,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@42bd2328, log id: 2a73d7b9 >2014-01-30 03:24:42,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f6ea0da >2014-01-30 03:24:43,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6f6ea0da >2014-01-30 03:24:43,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b3649ca >2014-01-30 03:24:43,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27d76a7e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@863c4e72}, log id: b3649ca >2014-01-30 03:24:43,718 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-10) [641a6d1] No up server in cluster >2014-01-30 03:24:43,718 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-10) [641a6d1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:24:43,721 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-10) [641a6d1] No up server in cluster >2014-01-30 03:24:43,721 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-10) [641a6d1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:24:43,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 449d1f74 >2014-01-30 03:24:44,231 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:24:44,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 449d1f74 >2014-01-30 03:24:48,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a7ab514 >2014-01-30 03:24:48,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5a7ab514 >2014-01-30 03:24:48,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6971500c >2014-01-30 03:24:49,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42a3be0b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8037c8b6}, log id: 6971500c >2014-01-30 03:24:49,248 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:24:54,267 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:24:54,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ae5ed02 >2014-01-30 03:24:54,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3ae5ed02 >2014-01-30 03:24:54,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32e135e4 >2014-01-30 03:24:55,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d1ac9e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d01f4019}, log id: 32e135e4 >2014-01-30 03:24:59,286 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:25:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [38892a17] Autorecovering 1 hosts >2014-01-30 03:25:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-62) [38892a17] Autorecovering hosts id: 80dfb2ba-85ca-41d0-9af5-8468c89e2354, name : host1 >2014-01-30 03:25:00,011 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-62) [2955db46] Lock Acquired to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 03:25:00,012 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-62) [2955db46] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:25:00,012 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-62) [2955db46] Before acquiring lock in order to prevent monitoring for host host1 from data-center Default >2014-01-30 03:25:00,012 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-62) [2955db46] Lock acquired, from now a monitoring of host will be skipped for host host1 from data-center Default >2014-01-30 03:25:00,019 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-62) [2955db46] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=Unassigned, nonOperationalReason=NONE), log id: 6b25fe3c >2014-01-30 03:25:00,024 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-62) [2955db46] FINISH, SetVdsStatusVDSCommand, log id: 6b25fe3c >2014-01-30 03:25:00,028 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-62) [2955db46] START, ActivateVdsVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 78fd06af >2014-01-30 03:25:00,094 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-62) [2955db46] START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, vds=Host[host1]), log id: 917c2a8 >2014-01-30 03:25:00,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13718db >2014-01-30 03:25:00,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-62) [2955db46] FINISH, GetHardwareInfoVDSCommand, log id: 917c2a8 >2014-01-30 03:25:00,136 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-62) [56e6cb25] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:25:00,137 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-62) [56e6cb25] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=NonOperational, nonOperationalReason=NETWORK_UNREACHABLE), log id: 72361b90 >2014-01-30 03:25:00,140 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-62) [56e6cb25] FINISH, SetVdsStatusVDSCommand, log id: 72361b90 >2014-01-30 03:25:00,143 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-62) [56e6cb25] Host host1 is set to Non-Operational, it is missing the following networks: ovirtmgmt >2014-01-30 03:25:00,148 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-62) [56e6cb25] Correlation ID: 56e6cb25, Job ID: c517f4bd-ba77-40a7-a7a0-c2e1f8fca8df, Call Stack: null, Custom Event ID: -1, Message: Host host1 does not comply with the cluster test_1 networks, the following networks are missing on host: 'ovirtmgmt' >2014-01-30 03:25:00,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [56e6cb25] START, GlusterServersListVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 4b1c9b72 >2014-01-30 03:25:00,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 13718db >2014-01-30 03:25:00,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 174cc059 >2014-01-30 03:25:00,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [56e6cb25] FINISH, GlusterServersListVDSCommand, return: [10.70.37.220:CONNECTED, 10.70.37.158:CONNECTED], log id: 4b1c9b72 >2014-01-30 03:25:00,633 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:25:00,634 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, ActivateVdsVDSCommand, return: Host[host1], log id: 78fd06af >2014-01-30 03:25:00,652 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] Activate finished. Lock released. Monitoring can run now for host host1 from data-center Default >2014-01-30 03:25:00,653 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] Lock freed to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 03:25:00,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8fc2715, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88705f08}, log id: 174cc059 >2014-01-30 03:25:04,308 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:25:05,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 259d2144 >2014-01-30 03:25:06,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 259d2144 >2014-01-30 03:25:06,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 300fa034 >2014-01-30 03:25:06,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0ade1e3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47722040}, log id: 300fa034 >2014-01-30 03:25:09,329 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-68) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:25:11,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19995866 >2014-01-30 03:25:12,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 19995866 >2014-01-30 03:25:12,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14c2bd35 >2014-01-30 03:25:12,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fc76f58, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c137b018}, log id: 14c2bd35 >2014-01-30 03:25:14,350 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:25:17,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4bb1ed11 >2014-01-30 03:25:18,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4bb1ed11 >2014-01-30 03:25:18,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29fce474 >2014-01-30 03:25:18,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72e0ad63, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65366701}, log id: 29fce474 >2014-01-30 03:25:19,372 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:25:23,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12302943 >2014-01-30 03:25:23,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 12302943 >2014-01-30 03:25:23,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: bae5613 >2014-01-30 03:25:24,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf483033, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a25faa41}, log id: bae5613 >2014-01-30 03:25:24,390 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-20) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:25:29,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27ecf35f >2014-01-30 03:25:29,406 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:25:29,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 27ecf35f >2014-01-30 03:25:29,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7275ba9b >2014-01-30 03:25:30,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9aa5ee73, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5380c7ef}, log id: 7275ba9b >2014-01-30 03:25:34,421 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:25:35,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 634e002 >2014-01-30 03:25:35,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 634e002 >2014-01-30 03:25:35,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 734d1a42 >2014-01-30 03:25:35,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f4f17de, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32cd5c8a}, log id: 734d1a42 >2014-01-30 03:25:39,441 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:25:40,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1252503f >2014-01-30 03:25:41,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1252503f >2014-01-30 03:25:41,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a0b517a >2014-01-30 03:25:41,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc707149, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c5bf58f}, log id: a0b517a >2014-01-30 03:25:44,465 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) [4f6d8cf4] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:25:44,565 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-53) No up server in cluster >2014-01-30 03:25:44,566 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-53) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:25:44,569 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-53) No up server in cluster >2014-01-30 03:25:44,569 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-53) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:25:44,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51339263 >2014-01-30 03:25:45,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 51339263 >2014-01-30 03:25:46,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60e7eeb1 >2014-01-30 03:25:47,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 60e7eeb1 >2014-01-30 03:25:47,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5eacfe55 >2014-01-30 03:25:47,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f44f09f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3385e06b}, log id: 5eacfe55 >2014-01-30 03:25:49,485 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-68) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:25:52,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [42330db] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ab992c4 >2014-01-30 03:25:53,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [42330db] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3ab992c4 >2014-01-30 03:25:53,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [42330db] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a0f19c0 >2014-01-30 03:25:53,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [42330db] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@225eee48, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9db1adf3}, log id: 1a0f19c0 >2014-01-30 03:25:54,504 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:25:58,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e1839fe >2014-01-30 03:25:58,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e1839fe >2014-01-30 03:25:58,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4160fa50 >2014-01-30 03:25:59,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@789d2103, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13c2e31d}, log id: 4160fa50 >2014-01-30 03:25:59,527 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:26:04,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [273f6e94] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58d186c8 >2014-01-30 03:26:04,549 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-40) [4237ee18] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:26:04,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [273f6e94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 58d186c8 >2014-01-30 03:26:04,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [273f6e94] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a860629 >2014-01-30 03:26:05,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [273f6e94] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5191f42c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1b46037}, log id: 1a860629 >2014-01-30 03:26:09,573 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:26:10,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33efe26f >2014-01-30 03:26:10,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 33efe26f >2014-01-30 03:26:10,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4697ea2d >2014-01-30 03:26:10,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c13bd71a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@edc3e3ef}, log id: 4697ea2d >2014-01-30 03:26:14,595 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:26:15,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6144625f >2014-01-30 03:26:16,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6144625f >2014-01-30 03:26:16,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64695c5d >2014-01-30 03:26:16,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a196d3a3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e78dd7dd}, log id: 64695c5d >2014-01-30 03:26:19,615 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:26:21,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48e4d51 >2014-01-30 03:26:22,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 48e4d51 >2014-01-30 03:26:22,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3346aadd >2014-01-30 03:26:22,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@322162af, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58f095eb}, log id: 3346aadd >2014-01-30 03:26:24,636 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:26:27,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a79345f >2014-01-30 03:26:28,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7a79345f >2014-01-30 03:26:28,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69dd2cd2 >2014-01-30 03:26:28,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@879eef83, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18234f96}, log id: 69dd2cd2 >2014-01-30 03:26:29,658 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:26:33,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a1d011b >2014-01-30 03:26:33,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a1d011b >2014-01-30 03:26:33,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22ccbbdf >2014-01-30 03:26:34,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@591ef6b6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e205250}, log id: 22ccbbdf >2014-01-30 03:26:34,680 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:26:39,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 446200a8 >2014-01-30 03:26:39,700 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:26:39,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 446200a8 >2014-01-30 03:26:39,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12db2df2 >2014-01-30 03:26:39,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe22313d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3d13ef9}, log id: 12db2df2 >2014-01-30 03:26:44,722 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:26:45,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [273f6e94] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4fc57bc7 >2014-01-30 03:26:45,415 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-6) [7c7776a1] No up server in cluster >2014-01-30 03:26:45,415 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-6) [7c7776a1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:26:45,418 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-6) [7c7776a1] No up server in cluster >2014-01-30 03:26:45,418 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-6) [7c7776a1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:26:45,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 29c79e80 >2014-01-30 03:26:45,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [273f6e94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4fc57bc7 >2014-01-30 03:26:45,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [273f6e94] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c0bee35 >2014-01-30 03:26:45,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [273f6e94] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c599cde2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63669874}, log id: 7c0bee35 >2014-01-30 03:26:46,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 29c79e80 >2014-01-30 03:26:49,742 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:26:50,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a441479 >2014-01-30 03:26:51,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1a441479 >2014-01-30 03:26:51,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25ae4872 >2014-01-30 03:26:51,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0edc8ac, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8acd4e}, log id: 25ae4872 >2014-01-30 03:26:54,762 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:26:56,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [23452111] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c2d7bb4 >2014-01-30 03:26:57,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [23452111] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2c2d7bb4 >2014-01-30 03:26:57,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [23452111] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: caca187 >2014-01-30 03:26:57,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [23452111] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b60b101, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e24e1c6d}, log id: caca187 >2014-01-30 03:26:59,785 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:27:02,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20403ca4 >2014-01-30 03:27:02,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 20403ca4 >2014-01-30 03:27:02,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 613d7be1 >2014-01-30 03:27:03,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0a103bf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87277f6}, log id: 613d7be1 >2014-01-30 03:27:04,806 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:27:08,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 538a2d1d >2014-01-30 03:27:08,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 538a2d1d >2014-01-30 03:27:08,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76dca44e >2014-01-30 03:27:09,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9915889, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18154190}, log id: 76dca44e >2014-01-30 03:27:09,827 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:27:14,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 63f0ac50 >2014-01-30 03:27:14,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 63f0ac50 >2014-01-30 03:27:14,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4977c43f >2014-01-30 03:27:14,850 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:27:14,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@144bc9fa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20d6da48}, log id: 4977c43f >2014-01-30 03:27:19,869 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:27:19,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 533bd542 >2014-01-30 03:27:20,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 533bd542 >2014-01-30 03:27:20,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2893438a >2014-01-30 03:27:20,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ebea664, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19521c69}, log id: 2893438a >2014-01-30 03:27:24,892 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:27:25,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 34cf8235 >2014-01-30 03:27:26,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 34cf8235 >2014-01-30 03:27:26,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 297ed9d5 >2014-01-30 03:27:26,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7201e21, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e63ce187}, log id: 297ed9d5 >2014-01-30 03:27:29,914 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:27:31,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52d22356 >2014-01-30 03:27:32,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 52d22356 >2014-01-30 03:27:32,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ec82727 >2014-01-30 03:27:32,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff8bd175, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe686939}, log id: 1ec82727 >2014-01-30 03:27:34,936 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:27:37,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b2e750 >2014-01-30 03:27:37,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3b2e750 >2014-01-30 03:27:37,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f397b30 >2014-01-30 03:27:38,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfebe1f4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@415c0c5f}, log id: f397b30 >2014-01-30 03:27:39,955 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:27:43,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b99ef61 >2014-01-30 03:27:43,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1b99ef61 >2014-01-30 03:27:43,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c6b0ea8 >2014-01-30 03:27:43,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6be0f88, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b581e37}, log id: 5c6b0ea8 >2014-01-30 03:27:44,978 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-73) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:27:46,216 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) [4376cca4] No up server in cluster >2014-01-30 03:27:46,216 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) [4376cca4] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:27:46,219 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) [4376cca4] No up server in cluster >2014-01-30 03:27:46,219 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) [4376cca4] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:27:46,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 27cd6874 >2014-01-30 03:27:47,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 27cd6874 >2014-01-30 03:27:48,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3515fc74 >2014-01-30 03:27:49,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3515fc74 >2014-01-30 03:27:49,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13588e74 >2014-01-30 03:27:49,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2d09a22, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6877883}, log id: 13588e74 >2014-01-30 03:27:49,999 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:27:54,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 516b7436 >2014-01-30 03:27:55,019 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-56) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:27:55,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 516b7436 >2014-01-30 03:27:55,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ae132ae >2014-01-30 03:27:55,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f65e3d44, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c589bd7}, log id: 3ae132ae >2014-01-30 03:28:00,037 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:28:00,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b25587b >2014-01-30 03:28:01,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1b25587b >2014-01-30 03:28:01,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10db65bf >2014-01-30 03:28:01,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91eecc86, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30ddcd27}, log id: 10db65bf >2014-01-30 03:28:05,059 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:28:06,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1971ddac >2014-01-30 03:28:06,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1971ddac >2014-01-30 03:28:06,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58171363 >2014-01-30 03:28:07,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8be7438, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c1dfcc8}, log id: 58171363 >2014-01-30 03:28:10,079 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:28:12,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 651de217 >2014-01-30 03:28:12,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 651de217 >2014-01-30 03:28:12,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c155d8 >2014-01-30 03:28:13,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f29ccfb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d746ba0f}, log id: c155d8 >2014-01-30 03:28:15,099 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:28:18,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 203a4fa0 >2014-01-30 03:28:18,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 203a4fa0 >2014-01-30 03:28:18,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12c2fcb1 >2014-01-30 03:28:18,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11de0f59, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7222042}, log id: 12c2fcb1 >2014-01-30 03:28:20,144 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:28:23,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4fe1d572 >2014-01-30 03:28:24,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4fe1d572 >2014-01-30 03:28:24,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1917f887 >2014-01-30 03:28:24,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a0ee47a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b116aeb6}, log id: 1917f887 >2014-01-30 03:28:25,164 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:28:29,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [42330db] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32eac5d1 >2014-01-30 03:28:30,186 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:28:30,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [42330db] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 32eac5d1 >2014-01-30 03:28:30,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [42330db] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 460df9b4 >2014-01-30 03:28:30,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [42330db] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de309b7e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@834aa6ce}, log id: 460df9b4 >2014-01-30 03:28:35,203 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:28:35,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4266e2cf >2014-01-30 03:28:36,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4266e2cf >2014-01-30 03:28:36,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 63ec742 >2014-01-30 03:28:36,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a66b6cf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a5cebcf}, log id: 63ec742 >2014-01-30 03:28:40,224 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:28:41,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67dde172 >2014-01-30 03:28:41,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 67dde172 >2014-01-30 03:28:41,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f47aed6 >2014-01-30 03:28:42,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef09b3f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1db5a3d4}, log id: f47aed6 >2014-01-30 03:28:45,243 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:28:47,060 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] No up server in cluster >2014-01-30 03:28:47,060 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:28:47,063 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] No up server in cluster >2014-01-30 03:28:47,063 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:28:47,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: e9850e >2014-01-30 03:28:47,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 645a118f >2014-01-30 03:28:47,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 645a118f >2014-01-30 03:28:47,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36a9150a >2014-01-30 03:28:47,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: e9850e >2014-01-30 03:28:47,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f13498e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@299f5dff}, log id: 36a9150a >2014-01-30 03:28:50,265 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:28:53,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c865005 >2014-01-30 03:28:53,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2c865005 >2014-01-30 03:28:53,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25afb1e9 >2014-01-30 03:28:53,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64f671f7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f20d83e0}, log id: 25afb1e9 >2014-01-30 03:28:55,286 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:28:58,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42466c79 >2014-01-30 03:28:59,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 42466c79 >2014-01-30 03:28:59,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4dd4c418 >2014-01-30 03:28:59,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b8ef498, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@639d095a}, log id: 4dd4c418 >2014-01-30 03:29:00,305 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:29:04,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a30c8d3 >2014-01-30 03:29:05,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4a30c8d3 >2014-01-30 03:29:05,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ff082cf >2014-01-30 03:29:05,326 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:29:05,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3dda393a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5761e453}, log id: 3ff082cf >2014-01-30 03:29:10,348 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-69) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:29:10,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19e0ce2a >2014-01-30 03:29:10,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 19e0ce2a >2014-01-30 03:29:10,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d21ffd4 >2014-01-30 03:29:11,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34f6035c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@801c4df2}, log id: 4d21ffd4 >2014-01-30 03:29:15,370 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-56) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:29:16,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a38de42 >2014-01-30 03:29:16,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7a38de42 >2014-01-30 03:29:16,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7fd2aa94 >2014-01-30 03:29:17,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62ce5943, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6124ccce}, log id: 7fd2aa94 >2014-01-30 03:29:20,389 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:29:22,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d0118b8 >2014-01-30 03:29:22,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3d0118b8 >2014-01-30 03:29:22,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1773c6b7 >2014-01-30 03:29:22,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6879f82, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@468cecde}, log id: 1773c6b7 >2014-01-30 03:29:25,411 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:29:28,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7bc39088 >2014-01-30 03:29:28,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7bc39088 >2014-01-30 03:29:28,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14b8425 >2014-01-30 03:29:28,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c97fa4c8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e950b45}, log id: 14b8425 >2014-01-30 03:29:30,431 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:29:33,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b0919a6 >2014-01-30 03:29:34,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1b0919a6 >2014-01-30 03:29:34,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e48e2b6 >2014-01-30 03:29:34,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2839a23d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12e5a9ff}, log id: 7e48e2b6 >2014-01-30 03:29:35,454 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:29:39,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 57040ff8 >2014-01-30 03:29:40,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 57040ff8 >2014-01-30 03:29:40,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 613e5839 >2014-01-30 03:29:40,333 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-53) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 03:29:40,476 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) [4f6d8cf4] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:29:40,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b0e78a5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@450d654a}, log id: 613e5839 >2014-01-30 03:29:40,487 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-53) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 03:29:40,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 1c542dfc >2014-01-30 03:29:40,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@73e65a88, log id: 1c542dfc >2014-01-30 03:29:40,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 1841d22a >2014-01-30 03:29:41,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7764bf18, log id: 1841d22a >2014-01-30 03:29:45,499 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:29:45,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e147e7 >2014-01-30 03:29:46,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3e147e7 >2014-01-30 03:29:46,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6eac7171 >2014-01-30 03:29:46,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f336b16, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61e4b9ea}, log id: 6eac7171 >2014-01-30 03:29:47,851 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-12) [690883a1] No up server in cluster >2014-01-30 03:29:47,852 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-12) [690883a1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:29:47,854 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-12) [690883a1] No up server in cluster >2014-01-30 03:29:47,855 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-12) [690883a1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:29:47,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 106beb59 >2014-01-30 03:29:48,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 106beb59 >2014-01-30 03:29:50,515 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:29:51,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4158e789 >2014-01-30 03:29:51,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4158e789 >2014-01-30 03:29:51,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 437bfd87 >2014-01-30 03:29:52,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@309d9a51, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79988efd}, log id: 437bfd87 >2014-01-30 03:29:55,537 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-56) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:29:57,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e1a42f >2014-01-30 03:29:57,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e1a42f >2014-01-30 03:29:57,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15b10fe8 >2014-01-30 03:29:57,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ab01d82, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e9a113d}, log id: 15b10fe8 >2014-01-30 03:30:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [273f6e94] Autorecovering 1 hosts >2014-01-30 03:30:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-13) [273f6e94] Autorecovering hosts id: 80dfb2ba-85ca-41d0-9af5-8468c89e2354, name : host1 >2014-01-30 03:30:00,012 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-13) [452afa84] Lock Acquired to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 03:30:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-13) [452afa84] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:30:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-13) [452afa84] Before acquiring lock in order to prevent monitoring for host host1 from data-center Default >2014-01-30 03:30:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-13) [452afa84] Lock acquired, from now a monitoring of host will be skipped for host host1 from data-center Default >2014-01-30 03:30:00,021 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-13) [452afa84] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=Unassigned, nonOperationalReason=NONE), log id: 37153a71 >2014-01-30 03:30:00,027 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-13) [452afa84] FINISH, SetVdsStatusVDSCommand, log id: 37153a71 >2014-01-30 03:30:00,030 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-13) [452afa84] START, ActivateVdsVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 112ca95f >2014-01-30 03:30:00,499 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-13) [452afa84] START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, vds=Host[host1]), log id: 3c76333c >2014-01-30 03:30:00,513 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-13) [452afa84] FINISH, GetHardwareInfoVDSCommand, log id: 3c76333c >2014-01-30 03:30:00,549 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-13) [46661e78] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:30:00,552 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-13) [46661e78] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=NonOperational, nonOperationalReason=NETWORK_UNREACHABLE), log id: 5dfe11af >2014-01-30 03:30:00,556 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-13) [46661e78] FINISH, SetVdsStatusVDSCommand, log id: 5dfe11af >2014-01-30 03:30:00,559 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-40) [4237ee18] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:30:00,563 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-13) [46661e78] Host host1 is set to Non-Operational, it is missing the following networks: ovirtmgmt >2014-01-30 03:30:00,573 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-13) [46661e78] Correlation ID: 46661e78, Job ID: fce23652-560a-40df-96ec-c07961a348ff, Call Stack: null, Custom Event ID: -1, Message: Host host1 does not comply with the cluster test_1 networks, the following networks are missing on host: 'ovirtmgmt' >2014-01-30 03:30:00,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [46661e78] START, GlusterServersListVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 175d4df6 >2014-01-30 03:30:01,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [46661e78] FINISH, GlusterServersListVDSCommand, return: [10.70.37.220:CONNECTED, 10.70.37.158:CONNECTED], log id: 175d4df6 >2014-01-30 03:30:01,071 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:30:01,072 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, ActivateVdsVDSCommand, return: Host[host1], log id: 112ca95f >2014-01-30 03:30:01,089 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] Activate finished. Lock released. Monitoring can run now for host host1 from data-center Default >2014-01-30 03:30:01,090 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] Lock freed to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 03:30:02,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79162706 >2014-01-30 03:30:03,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 79162706 >2014-01-30 03:30:03,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76e99c5b >2014-01-30 03:30:03,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@181b2b3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e42aebf}, log id: 76e99c5b >2014-01-30 03:30:05,576 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:30:08,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18da7dd4 >2014-01-30 03:30:09,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 18da7dd4 >2014-01-30 03:30:09,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33e428b6 >2014-01-30 03:30:09,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ea6127c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df6a01d4}, log id: 33e428b6 >2014-01-30 03:30:10,600 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:30:14,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ec98ffc >2014-01-30 03:30:15,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6ec98ffc >2014-01-30 03:30:15,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f0679d6 >2014-01-30 03:30:15,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5389afdb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@caac8a13}, log id: 3f0679d6 >2014-01-30 03:30:15,622 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:30:20,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11dfe879 >2014-01-30 03:30:20,643 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:30:20,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 11dfe879 >2014-01-30 03:30:20,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78bf5b93 >2014-01-30 03:30:21,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6802f1b9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea8b6759}, log id: 78bf5b93 >2014-01-30 03:30:25,662 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-68) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:30:26,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ceb49bb >2014-01-30 03:30:26,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4ceb49bb >2014-01-30 03:30:26,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6961a81 >2014-01-30 03:30:27,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b3ed4ac, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27cd9aa5}, log id: 6961a81 >2014-01-30 03:30:30,684 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:30:32,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35873580 >2014-01-30 03:30:32,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 35873580 >2014-01-30 03:30:32,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74547238 >2014-01-30 03:30:32,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82c73f9d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@144ae4a8}, log id: 74547238 >2014-01-30 03:30:35,705 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:30:37,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46ee49de >2014-01-30 03:30:38,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 46ee49de >2014-01-30 03:30:38,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d89dac5 >2014-01-30 03:30:38,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@690c5dae, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab49aa6f}, log id: 7d89dac5 >2014-01-30 03:30:40,725 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:30:43,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6715c5d9 >2014-01-30 03:30:44,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6715c5d9 >2014-01-30 03:30:44,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4672fcc0 >2014-01-30 03:30:44,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6c0161f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad6d65fc}, log id: 4672fcc0 >2014-01-30 03:30:45,746 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:30:48,663 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-54) [2214a5ea] No up server in cluster >2014-01-30 03:30:48,663 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:30:48,666 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-54) [2214a5ea] No up server in cluster >2014-01-30 03:30:48,666 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:30:48,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69b3996d >2014-01-30 03:30:49,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 69b3996d >2014-01-30 03:30:49,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48fd385d >2014-01-30 03:30:50,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 48fd385d >2014-01-30 03:30:50,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 45792d5d >2014-01-30 03:30:50,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc8c0ff, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97a77dff}, log id: 45792d5d >2014-01-30 03:30:50,765 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:30:55,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f347408 >2014-01-30 03:30:55,781 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:30:55,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5f347408 >2014-01-30 03:30:55,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18d6ff68 >2014-01-30 03:30:56,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@baf0bceb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@292e9914}, log id: 18d6ff68 >2014-01-30 03:31:00,801 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-53) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:31:01,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41ae24 >2014-01-30 03:31:01,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 41ae24 >2014-01-30 03:31:01,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f6a002d >2014-01-30 03:31:01,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8210eaba, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51c0d655}, log id: 7f6a002d >2014-01-30 03:31:05,821 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-68) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:31:06,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 242beeb2 >2014-01-30 03:31:07,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 242beeb2 >2014-01-30 03:31:07,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 211bf071 >2014-01-30 03:31:07,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@143bd97a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f944efb3}, log id: 211bf071 >2014-01-30 03:31:10,841 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:31:12,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 575b4e32 >2014-01-30 03:31:13,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 575b4e32 >2014-01-30 03:31:13,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 675f50a3 >2014-01-30 03:31:13,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@610aa3fe, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c601194}, log id: 675f50a3 >2014-01-30 03:31:15,866 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:31:18,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4237ee18] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41206542 >2014-01-30 03:31:19,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4237ee18] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 41206542 >2014-01-30 03:31:19,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4237ee18] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e152f2f >2014-01-30 03:31:19,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4237ee18] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e87ee84f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b19bc750}, log id: 7e152f2f >2014-01-30 03:31:20,888 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:31:24,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3180b1a5 >2014-01-30 03:31:24,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3180b1a5 >2014-01-30 03:31:24,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7afae9ad >2014-01-30 03:31:25,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96d4493a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26d6e445}, log id: 7afae9ad >2014-01-30 03:31:25,909 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:31:30,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ab84250 >2014-01-30 03:31:30,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6ab84250 >2014-01-30 03:31:30,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60624447 >2014-01-30 03:31:30,930 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:31:31,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48cf0e52, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb2fdd6a}, log id: 60624447 >2014-01-30 03:31:35,951 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:31:36,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 61a6d675 >2014-01-30 03:31:36,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 61a6d675 >2014-01-30 03:31:36,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58a668d >2014-01-30 03:31:36,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a0f49a7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b1d12fa}, log id: 58a668d >2014-01-30 03:31:40,969 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-28) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:31:41,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 656e9074 >2014-01-30 03:31:42,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 656e9074 >2014-01-30 03:31:42,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21517aaa >2014-01-30 03:31:42,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f22291c3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2efd20b5}, log id: 21517aaa >2014-01-30 03:31:45,992 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:31:47,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15bcb8cb >2014-01-30 03:31:48,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 15bcb8cb >2014-01-30 03:31:48,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f43cfc7 >2014-01-30 03:31:48,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4382033, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73cd7820}, log id: 1f43cfc7 >2014-01-30 03:31:49,491 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-24) [3310e3f9] No up server in cluster >2014-01-30 03:31:49,491 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-24) [3310e3f9] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:31:49,495 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-24) [3310e3f9] No up server in cluster >2014-01-30 03:31:49,495 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-24) [3310e3f9] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:31:49,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 25c53223 >2014-01-30 03:31:50,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 25c53223 >2014-01-30 03:31:51,010 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:31:53,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 142fed9e >2014-01-30 03:31:53,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 142fed9e >2014-01-30 03:31:53,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11655617 >2014-01-30 03:31:54,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84ac72d2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6b426c7}, log id: 11655617 >2014-01-30 03:31:56,032 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:31:59,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f17292a >2014-01-30 03:31:59,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: f17292a >2014-01-30 03:31:59,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b52281e >2014-01-30 03:32:00,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff9ede00, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5502e8ef}, log id: 7b52281e >2014-01-30 03:32:01,055 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:32:05,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27e0fe78 >2014-01-30 03:32:05,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 27e0fe78 >2014-01-30 03:32:05,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 294a100b >2014-01-30 03:32:05,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8c67f42, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4f1b207}, log id: 294a100b >2014-01-30 03:32:06,072 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:32:10,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65af56e6 >2014-01-30 03:32:11,090 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:32:11,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 65af56e6 >2014-01-30 03:32:11,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c4f0cc8 >2014-01-30 03:32:11,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1026c8b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7abaaea4}, log id: c4f0cc8 >2014-01-30 03:32:16,110 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:32:16,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3981ac16 >2014-01-30 03:32:17,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3981ac16 >2014-01-30 03:32:17,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d0386b0 >2014-01-30 03:32:17,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bcf9d32, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f0e3551}, log id: 7d0386b0 >2014-01-30 03:32:21,130 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-53) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:32:22,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: afbf36f >2014-01-30 03:32:23,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: afbf36f >2014-01-30 03:32:23,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69cf5b0 >2014-01-30 03:32:23,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a062b9ef, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0fba408}, log id: 69cf5b0 >2014-01-30 03:32:26,150 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:32:28,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a501074 >2014-01-30 03:32:28,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2a501074 >2014-01-30 03:32:28,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f9f513e >2014-01-30 03:32:29,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97e67ac1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8da2ff9}, log id: 4f9f513e >2014-01-30 03:32:31,170 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:32:34,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c7b1304 >2014-01-30 03:32:34,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4c7b1304 >2014-01-30 03:32:34,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 489f3e90 >2014-01-30 03:32:34,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41938dd8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37d46a78}, log id: 489f3e90 >2014-01-30 03:32:36,191 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:32:40,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4208227d >2014-01-30 03:32:40,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4208227d >2014-01-30 03:32:40,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37d7ab19 >2014-01-30 03:32:40,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0a4aef4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5cacbf4f}, log id: 37d7ab19 >2014-01-30 03:32:41,211 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:32:45,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5406c348 >2014-01-30 03:32:46,232 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:32:46,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5406c348 >2014-01-30 03:32:46,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7409c6d6 >2014-01-30 03:32:46,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29e4d79, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@226772b1}, log id: 7409c6d6 >2014-01-30 03:32:50,351 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) [68161e48] No up server in cluster >2014-01-30 03:32:50,351 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) [68161e48] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:32:50,354 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) [68161e48] No up server in cluster >2014-01-30 03:32:50,355 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) [68161e48] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:32:50,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 6d7c6bc4 >2014-01-30 03:32:51,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 6d7c6bc4 >2014-01-30 03:32:51,253 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:32:51,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33817140 >2014-01-30 03:32:52,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 33817140 >2014-01-30 03:32:52,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23c37d95 >2014-01-30 03:32:52,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2633dc8f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33c20be3}, log id: 23c37d95 >2014-01-30 03:32:56,274 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-45) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:32:57,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f7e1484 >2014-01-30 03:32:57,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5f7e1484 >2014-01-30 03:32:57,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ea92483 >2014-01-30 03:32:58,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ad0499c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8fb97a64}, log id: 3ea92483 >2014-01-30 03:33:01,296 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:33:03,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [42330db] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7fe4cc19 >2014-01-30 03:33:03,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [42330db] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7fe4cc19 >2014-01-30 03:33:03,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [42330db] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37fcb380 >2014-01-30 03:33:04,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [42330db] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcf51b79, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@220a4d9c}, log id: 37fcb380 >2014-01-30 03:33:06,317 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-69) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:33:09,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31b177da >2014-01-30 03:33:09,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 31b177da >2014-01-30 03:33:09,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c8ef32 >2014-01-30 03:33:09,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec8068cf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c3e1015}, log id: 6c8ef32 >2014-01-30 03:33:11,335 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:33:14,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17e9af87 >2014-01-30 03:33:15,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 17e9af87 >2014-01-30 03:33:15,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 474b57e8 >2014-01-30 03:33:15,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be6fc3c1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61a59f5d}, log id: 474b57e8 >2014-01-30 03:33:16,358 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:33:20,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 670dba8e >2014-01-30 03:33:21,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 670dba8e >2014-01-30 03:33:21,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 534e193d >2014-01-30 03:33:21,376 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:33:21,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78c97650, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b05a02bc}, log id: 534e193d >2014-01-30 03:33:26,395 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:33:26,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64fb99ff >2014-01-30 03:33:27,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 64fb99ff >2014-01-30 03:33:27,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 538e17e5 >2014-01-30 03:33:27,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb071b10, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@274008aa}, log id: 538e17e5 >2014-01-30 03:33:31,415 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:33:32,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1615214f >2014-01-30 03:33:32,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1615214f >2014-01-30 03:33:32,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33cbae0f >2014-01-30 03:33:33,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f86231f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4784b2b2}, log id: 33cbae0f >2014-01-30 03:33:36,434 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:33:38,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 673082e2 >2014-01-30 03:33:38,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 673082e2 >2014-01-30 03:33:38,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a274fc >2014-01-30 03:33:38,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6873659b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ab831ab}, log id: 3a274fc >2014-01-30 03:33:41,457 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:33:44,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 61a71cf >2014-01-30 03:33:44,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 61a71cf >2014-01-30 03:33:44,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c0a3add >2014-01-30 03:33:44,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@190a1470, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49f2d8fa}, log id: 1c0a3add >2014-01-30 03:33:46,477 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:33:49,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e200669 >2014-01-30 03:33:50,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e200669 >2014-01-30 03:33:50,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f5e36d5 >2014-01-30 03:33:50,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d34ca741, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c332ae2a}, log id: 2f5e36d5 >2014-01-30 03:33:51,170 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] No up server in cluster >2014-01-30 03:33:51,170 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:33:51,174 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] No up server in cluster >2014-01-30 03:33:51,174 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:33:51,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 39e50c2b >2014-01-30 03:33:51,498 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:33:51,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 39e50c2b >2014-01-30 03:33:55,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 177ae31c >2014-01-30 03:33:56,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 177ae31c >2014-01-30 03:33:56,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1875b591 >2014-01-30 03:33:56,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebede388, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee02c28}, log id: 1875b591 >2014-01-30 03:33:56,519 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:34:01,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c27914f >2014-01-30 03:34:01,534 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:34:01,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2c27914f >2014-01-30 03:34:01,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e2326f0 >2014-01-30 03:34:02,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bcd5d86d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@274902e8}, log id: 3e2326f0 >2014-01-30 03:34:06,552 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:34:07,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f0e2ab3 >2014-01-30 03:34:07,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: f0e2ab3 >2014-01-30 03:34:07,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a6ada2f >2014-01-30 03:34:08,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78ae8eec, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2aa836f}, log id: 4a6ada2f >2014-01-30 03:34:11,574 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:34:13,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44a0004e >2014-01-30 03:34:13,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 44a0004e >2014-01-30 03:34:13,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c66f66e >2014-01-30 03:34:13,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d989e8fc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96d25959}, log id: 4c66f66e >2014-01-30 03:34:16,594 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-45) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:34:18,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d305dd8 >2014-01-30 03:34:19,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7d305dd8 >2014-01-30 03:34:19,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d127060 >2014-01-30 03:34:19,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@267e6c5b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bcf02128}, log id: 7d127060 >2014-01-30 03:34:21,615 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:34:24,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 584b515b >2014-01-30 03:34:25,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 584b515b >2014-01-30 03:34:25,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 379a071a >2014-01-30 03:34:25,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8332927f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c26e77a}, log id: 379a071a >2014-01-30 03:34:26,637 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-69) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:34:30,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 73ced70c >2014-01-30 03:34:31,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 73ced70c >2014-01-30 03:34:31,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d775630 >2014-01-30 03:34:31,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93260e65, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2188a340}, log id: 5d775630 >2014-01-30 03:34:31,656 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:34:36,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 421e5f8d >2014-01-30 03:34:36,679 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:34:36,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 421e5f8d >2014-01-30 03:34:36,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a368340 >2014-01-30 03:34:37,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3ee6134, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1619202}, log id: 5a368340 >2014-01-30 03:34:41,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 331137a >2014-01-30 03:34:41,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2c05e7ea, log id: 331137a >2014-01-30 03:34:41,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37bcca3a >2014-01-30 03:34:41,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@666fba9b, log id: 37bcca3a >2014-01-30 03:34:41,698 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:34:42,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53ef1dd6 >2014-01-30 03:34:42,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 53ef1dd6 >2014-01-30 03:34:42,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 398dfb2d >2014-01-30 03:34:42,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c135b950, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81373ab1}, log id: 398dfb2d >2014-01-30 03:34:46,720 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:34:48,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22b98cb0 >2014-01-30 03:34:48,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 22b98cb0 >2014-01-30 03:34:48,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a04a09e >2014-01-30 03:34:48,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@682b6c59, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@813829df}, log id: 4a04a09e >2014-01-30 03:34:51,742 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) [4f6d8cf4] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:34:52,006 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2014-01-30 03:34:52,006 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:34:52,009 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2014-01-30 03:34:52,009 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:34:52,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 69bc81dd >2014-01-30 03:34:52,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 69bc81dd >2014-01-30 03:34:53,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d2ca1d5 >2014-01-30 03:34:54,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7d2ca1d5 >2014-01-30 03:34:54,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 235587c4 >2014-01-30 03:34:54,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b33160f3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46c81fd9}, log id: 235587c4 >2014-01-30 03:34:56,765 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:34:59,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 73fb6d4e >2014-01-30 03:35:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [42330db] Autorecovering 1 hosts >2014-01-30 03:35:00,006 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-98) [42330db] Autorecovering hosts id: 80dfb2ba-85ca-41d0-9af5-8468c89e2354, name : host1 >2014-01-30 03:35:00,007 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-98) [3205b428] Lock Acquired to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 03:35:00,008 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-98) [3205b428] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:35:00,008 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-98) [3205b428] Before acquiring lock in order to prevent monitoring for host host1 from data-center Default >2014-01-30 03:35:00,008 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-98) [3205b428] Lock acquired, from now a monitoring of host will be skipped for host host1 from data-center Default >2014-01-30 03:35:00,011 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-98) [3205b428] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=Unassigned, nonOperationalReason=NONE), log id: 6de26e75 >2014-01-30 03:35:00,016 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-98) [3205b428] FINISH, SetVdsStatusVDSCommand, log id: 6de26e75 >2014-01-30 03:35:00,017 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-98) [3205b428] START, ActivateVdsVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 237e5db1 >2014-01-30 03:35:00,072 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-98) [3205b428] START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, vds=Host[host1]), log id: 167b5cfe >2014-01-30 03:35:00,081 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-98) [3205b428] FINISH, GetHardwareInfoVDSCommand, log id: 167b5cfe >2014-01-30 03:35:00,102 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-98) [5b01f92a] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:35:00,103 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-98) [5b01f92a] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=NonOperational, nonOperationalReason=NETWORK_UNREACHABLE), log id: 5b5607a8 >2014-01-30 03:35:00,106 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-98) [5b01f92a] FINISH, SetVdsStatusVDSCommand, log id: 5b5607a8 >2014-01-30 03:35:00,111 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-98) [5b01f92a] Host host1 is set to Non-Operational, it is missing the following networks: ovirtmgmt >2014-01-30 03:35:00,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 73fb6d4e >2014-01-30 03:35:00,123 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-98) [5b01f92a] Correlation ID: 5b01f92a, Job ID: 43ea84fb-592d-4473-9514-f5518516f808, Call Stack: null, Custom Event ID: -1, Message: Host host1 does not comply with the cluster test_1 networks, the following networks are missing on host: 'ovirtmgmt' >2014-01-30 03:35:00,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 570e7a89 >2014-01-30 03:35:00,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [5b01f92a] START, GlusterServersListVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 2b830286 >2014-01-30 03:35:00,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2603760, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b3f95a4}, log id: 570e7a89 >2014-01-30 03:35:00,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [5b01f92a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.220:CONNECTED, 10.70.37.158:CONNECTED], log id: 2b830286 >2014-01-30 03:35:00,607 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:35:00,609 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, ActivateVdsVDSCommand, return: Host[host1], log id: 237e5db1 >2014-01-30 03:35:00,636 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] Activate finished. Lock released. Monitoring can run now for host host1 from data-center Default >2014-01-30 03:35:00,639 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] Lock freed to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 03:35:01,783 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:35:05,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6dc64c5f >2014-01-30 03:35:05,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6dc64c5f >2014-01-30 03:35:05,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77f66d65 >2014-01-30 03:35:06,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b7dc42e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5524d318}, log id: 77f66d65 >2014-01-30 03:35:06,803 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:35:11,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f944c3 >2014-01-30 03:35:11,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f944c3 >2014-01-30 03:35:11,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a60662d >2014-01-30 03:35:11,823 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:35:12,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74fbfbf1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a12b0f78}, log id: 2a60662d >2014-01-30 03:35:16,845 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:35:17,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40f4f530 >2014-01-30 03:35:17,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 40f4f530 >2014-01-30 03:35:17,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e75ad05 >2014-01-30 03:35:17,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84766364, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a41d102}, log id: 2e75ad05 >2014-01-30 03:35:21,865 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:35:22,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c6946c4 >2014-01-30 03:35:23,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: c6946c4 >2014-01-30 03:35:23,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: cedbd5e >2014-01-30 03:35:23,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76721f2c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24f9270f}, log id: cedbd5e >2014-01-30 03:35:26,886 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:35:28,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2081f6e7 >2014-01-30 03:35:29,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2081f6e7 >2014-01-30 03:35:29,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72ea7eb2 >2014-01-30 03:35:29,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b008ac1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ef8c391}, log id: 72ea7eb2 >2014-01-30 03:35:31,908 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:35:34,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29865bd >2014-01-30 03:35:35,002 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-64) [4dd3051e] Start deleteAgedOutAuditLogs >2014-01-30 03:35:35,010 INFO [org.ovirt.engine.core.bll.AuditLogCleanupManager] (DefaultQuartzScheduler_Worker-64) [4dd3051e] Finished deleteAgedOutAuditLogs >2014-01-30 03:35:35,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 29865bd >2014-01-30 03:35:35,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a6e544f >2014-01-30 03:35:35,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6156c81b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@930a0ac7}, log id: a6e544f >2014-01-30 03:35:36,929 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-53) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:35:40,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b84f9de >2014-01-30 03:35:40,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b84f9de >2014-01-30 03:35:40,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d45149d >2014-01-30 03:35:41,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@721d149f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@128fae51}, log id: 1d45149d >2014-01-30 03:35:41,950 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:35:46,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48081c54 >2014-01-30 03:35:46,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 48081c54 >2014-01-30 03:35:46,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c3f07fe >2014-01-30 03:35:46,974 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:35:46,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43820e99, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86da0aae}, log id: 3c3f07fe >2014-01-30 03:35:51,995 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:35:52,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31dd7f26 >2014-01-30 03:35:52,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 31dd7f26 >2014-01-30 03:35:52,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4897505e >2014-01-30 03:35:52,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b32a26ee, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@176d1992}, log id: 4897505e >2014-01-30 03:35:52,824 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-23) [2517ed6c] No up server in cluster >2014-01-30 03:35:52,824 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:35:52,827 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-23) [2517ed6c] No up server in cluster >2014-01-30 03:35:52,827 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:35:52,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 2a63323a >2014-01-30 03:35:53,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 2a63323a >2014-01-30 03:35:57,017 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:35:57,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41462cb3 >2014-01-30 03:35:58,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 41462cb3 >2014-01-30 03:35:58,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74fb3c9e >2014-01-30 03:35:58,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39b13c91, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@108e6b10}, log id: 74fb3c9e >2014-01-30 03:36:02,041 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:36:03,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [23452111] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11a1c3ca >2014-01-30 03:36:04,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [23452111] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 11a1c3ca >2014-01-30 03:36:04,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [23452111] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b016088 >2014-01-30 03:36:04,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [23452111] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c78be0d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab70f380}, log id: 4b016088 >2014-01-30 03:36:07,064 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:36:09,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f9d438d >2014-01-30 03:36:09,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1f9d438d >2014-01-30 03:36:09,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69032744 >2014-01-30 03:36:10,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5d67e2e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8913f6a0}, log id: 69032744 >2014-01-30 03:36:12,083 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:36:15,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f788594 >2014-01-30 03:36:15,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6f788594 >2014-01-30 03:36:15,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d7d8316 >2014-01-30 03:36:16,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b9aeacc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7baba534}, log id: 6d7d8316 >2014-01-30 03:36:17,100 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:36:21,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7dad4a0e >2014-01-30 03:36:21,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7dad4a0e >2014-01-30 03:36:21,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7aa673d3 >2014-01-30 03:36:21,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4a71b11, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1663a3c8}, log id: 7aa673d3 >2014-01-30 03:36:22,121 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:36:26,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f3f7a57 >2014-01-30 03:36:27,141 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-56) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:36:27,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f3f7a57 >2014-01-30 03:36:27,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d4701f0 >2014-01-30 03:36:27,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3b0ffbd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24ce59ad}, log id: 6d4701f0 >2014-01-30 03:36:32,161 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:36:32,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 45da965c >2014-01-30 03:36:33,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 45da965c >2014-01-30 03:36:33,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7699e077 >2014-01-30 03:36:33,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6bc05e64, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3d8ce5b}, log id: 7699e077 >2014-01-30 03:36:37,182 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:36:38,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e7a5a5b >2014-01-30 03:36:38,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e7a5a5b >2014-01-30 03:36:38,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b06cf64 >2014-01-30 03:36:39,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f19da084, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5caee527}, log id: 4b06cf64 >2014-01-30 03:36:42,202 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:36:44,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8cafacf >2014-01-30 03:36:44,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 8cafacf >2014-01-30 03:36:44,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1677f874 >2014-01-30 03:36:45,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f356637d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1feeefba}, log id: 1677f874 >2014-01-30 03:36:47,222 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-50) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:36:50,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25f3cd85 >2014-01-30 03:36:50,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 25f3cd85 >2014-01-30 03:36:50,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 499b4ad8 >2014-01-30 03:36:50,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6060121, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a267ade9}, log id: 499b4ad8 >2014-01-30 03:36:52,242 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-4) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:36:53,655 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] No up server in cluster >2014-01-30 03:36:53,656 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:36:53,659 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] No up server in cluster >2014-01-30 03:36:53,659 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:36:53,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 154ff7e5 >2014-01-30 03:36:54,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 154ff7e5 >2014-01-30 03:36:55,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7087daa0 >2014-01-30 03:36:56,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7087daa0 >2014-01-30 03:36:56,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 513710d0 >2014-01-30 03:36:56,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f06f09e6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2e695ca}, log id: 513710d0 >2014-01-30 03:36:57,263 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-53) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:37:01,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5859fa93 >2014-01-30 03:37:02,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5859fa93 >2014-01-30 03:37:02,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 254dd331 >2014-01-30 03:37:02,284 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:37:02,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d5b7dd7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74dab051}, log id: 254dd331 >2014-01-30 03:37:07,306 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:37:07,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f9f16d9 >2014-01-30 03:37:08,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6f9f16d9 >2014-01-30 03:37:08,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74ed3023 >2014-01-30 03:37:08,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58c211ff, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9a060fa}, log id: 74ed3023 >2014-01-30 03:37:12,328 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:37:13,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c9d3233 >2014-01-30 03:37:13,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c9d3233 >2014-01-30 03:37:13,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b4c1694 >2014-01-30 03:37:14,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e9ba517, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23a747e6}, log id: b4c1694 >2014-01-30 03:37:17,348 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:37:19,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fc2273e >2014-01-30 03:37:19,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3fc2273e >2014-01-30 03:37:19,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7560733c >2014-01-30 03:37:19,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d455e866, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd619343}, log id: 7560733c >2014-01-30 03:37:23,527 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:37:24,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 678e95c5 >2014-01-30 03:37:25,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 678e95c5 >2014-01-30 03:37:25,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f54861d >2014-01-30 03:37:25,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24edcba2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@997ca983}, log id: f54861d >2014-01-30 03:37:28,547 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:37:30,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d3ffa2f >2014-01-30 03:37:31,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6d3ffa2f >2014-01-30 03:37:31,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a0020a2 >2014-01-30 03:37:31,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74834a35, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84dd6f9c}, log id: 6a0020a2 >2014-01-30 03:37:33,567 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:37:36,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2bc3ad7d >2014-01-30 03:37:37,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2bc3ad7d >2014-01-30 03:37:37,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68d28fc4 >2014-01-30 03:37:37,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb1b201d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d92fcdd}, log id: 68d28fc4 >2014-01-30 03:37:38,590 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:37:42,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c13b542 >2014-01-30 03:37:42,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: c13b542 >2014-01-30 03:37:42,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a820f6 >2014-01-30 03:37:43,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9180760f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcc86a21}, log id: 7a820f6 >2014-01-30 03:37:43,611 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:37:48,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f8f3045 >2014-01-30 03:37:48,631 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:37:48,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2f8f3045 >2014-01-30 03:37:48,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4dae75cc >2014-01-30 03:37:49,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e021fbb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d0b5084}, log id: 4dae75cc >2014-01-30 03:37:53,652 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:37:54,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50d3c15a >2014-01-30 03:37:54,459 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-96) [444c158d] No up server in cluster >2014-01-30 03:37:54,459 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-96) [444c158d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:37:54,462 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-96) [444c158d] No up server in cluster >2014-01-30 03:37:54,462 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-96) [444c158d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:37:54,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 77276336 >2014-01-30 03:37:54,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 50d3c15a >2014-01-30 03:37:54,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5598c472 >2014-01-30 03:37:54,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2a305ea, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e308991a}, log id: 5598c472 >2014-01-30 03:37:55,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 77276336 >2014-01-30 03:37:58,675 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:37:59,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 34b29f13 >2014-01-30 03:38:00,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 34b29f13 >2014-01-30 03:38:00,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74d82f5d >2014-01-30 03:38:00,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@211c6775, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfbcbd1f}, log id: 74d82f5d >2014-01-30 03:38:03,698 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:38:05,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 377da3ba >2014-01-30 03:38:06,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 377da3ba >2014-01-30 03:38:06,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e2a2673 >2014-01-30 03:38:06,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbe6204f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a73b2cee}, log id: 4e2a2673 >2014-01-30 03:38:08,721 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) [4f6d8cf4] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:38:11,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 738fc293 >2014-01-30 03:38:12,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 738fc293 >2014-01-30 03:38:12,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ba31836 >2014-01-30 03:38:12,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5a35212, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e758fe05}, log id: 6ba31836 >2014-01-30 03:38:13,743 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-45) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:38:17,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 643ee6da >2014-01-30 03:38:17,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 643ee6da >2014-01-30 03:38:17,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 70b68154 >2014-01-30 03:38:18,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa958d7d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3f96b38}, log id: 70b68154 >2014-01-30 03:38:18,766 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-68) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:38:23,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 629233fb >2014-01-30 03:38:23,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 629233fb >2014-01-30 03:38:23,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 70d33e41 >2014-01-30 03:38:23,788 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:38:23,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1339a279, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8cc8eae7}, log id: 70d33e41 >2014-01-30 03:38:28,807 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:38:29,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b4efee8 >2014-01-30 03:38:29,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2b4efee8 >2014-01-30 03:38:29,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46e4ff3c >2014-01-30 03:38:29,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8b05d9c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3273a63}, log id: 46e4ff3c >2014-01-30 03:38:33,830 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:38:34,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7080c6a5 >2014-01-30 03:38:35,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7080c6a5 >2014-01-30 03:38:35,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b1d5191 >2014-01-30 03:38:35,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cc5fcd2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@180ece16}, log id: 5b1d5191 >2014-01-30 03:38:38,852 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:38:40,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 963f458 >2014-01-30 03:38:41,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 963f458 >2014-01-30 03:38:41,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 211ab339 >2014-01-30 03:38:41,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14ec189a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95aa6ba1}, log id: 211ab339 >2014-01-30 03:38:43,874 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:38:46,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19de11d4 >2014-01-30 03:38:46,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 19de11d4 >2014-01-30 03:38:46,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ab398d1 >2014-01-30 03:38:47,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bcc62219, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@777c97e0}, log id: 3ab398d1 >2014-01-30 03:38:48,896 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) [4f6d8cf4] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:38:52,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e34053 >2014-01-30 03:38:52,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7e34053 >2014-01-30 03:38:52,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 427d450d >2014-01-30 03:38:53,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2bbdf1bd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@789535f8}, log id: 427d450d >2014-01-30 03:38:53,916 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:38:55,316 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-52) [2414cdcb] No up server in cluster >2014-01-30 03:38:55,316 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-52) [2414cdcb] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:38:55,320 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-52) [2414cdcb] No up server in cluster >2014-01-30 03:38:55,320 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-52) [2414cdcb] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:38:55,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 18c53762 >2014-01-30 03:38:56,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 18c53762 >2014-01-30 03:38:58,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 972eda8 >2014-01-30 03:38:58,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 972eda8 >2014-01-30 03:38:58,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 765b8839 >2014-01-30 03:38:58,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d76a1687, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e60c5959}, log id: 765b8839 >2014-01-30 03:38:58,935 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:39:03,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43e04365 >2014-01-30 03:39:03,971 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:39:04,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43e04365 >2014-01-30 03:39:04,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 55ce5332 >2014-01-30 03:39:04,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@290313f1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb5b3f38}, log id: 55ce5332 >2014-01-30 03:39:08,989 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:39:09,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3926ecc5 >2014-01-30 03:39:10,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3926ecc5 >2014-01-30 03:39:10,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7db0fe97 >2014-01-30 03:39:10,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b45ac20, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffd9d461}, log id: 7db0fe97 >2014-01-30 03:39:14,006 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:39:15,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16e505b5 >2014-01-30 03:39:16,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 16e505b5 >2014-01-30 03:39:16,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 277b2274 >2014-01-30 03:39:16,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2b83e58, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dca6eb31}, log id: 277b2274 >2014-01-30 03:39:19,028 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:39:21,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 55a996 >2014-01-30 03:39:21,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 55a996 >2014-01-30 03:39:21,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40c61178 >2014-01-30 03:39:22,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be0b0230, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a395c79d}, log id: 40c61178 >2014-01-30 03:39:24,048 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:39:27,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 404a846d >2014-01-30 03:39:27,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 404a846d >2014-01-30 03:39:27,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e27cf3b >2014-01-30 03:39:28,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a254cfee, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82b073ed}, log id: 2e27cf3b >2014-01-30 03:39:29,071 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:39:33,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a098f62 >2014-01-30 03:39:33,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5a098f62 >2014-01-30 03:39:33,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65d6cf21 >2014-01-30 03:39:33,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac705d5a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd329fa0}, log id: 65d6cf21 >2014-01-30 03:39:34,090 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-28) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:39:38,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f8aa9ca >2014-01-30 03:39:39,111 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:39:39,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6f8aa9ca >2014-01-30 03:39:39,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42588271 >2014-01-30 03:39:39,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9fe8d45, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7226509}, log id: 42588271 >2014-01-30 03:39:41,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 7b85199f >2014-01-30 03:39:41,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2510eac7, log id: 7b85199f >2014-01-30 03:39:41,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 79a5c1d3 >2014-01-30 03:39:42,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@41b00088, log id: 79a5c1d3 >2014-01-30 03:39:44,127 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:39:44,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 534f4443 >2014-01-30 03:39:45,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 534f4443 >2014-01-30 03:39:45,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b7374d9 >2014-01-30 03:39:45,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9234c6c0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a499a49}, log id: 6b7374d9 >2014-01-30 03:39:49,146 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:39:50,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78712ad1 >2014-01-30 03:39:51,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 78712ad1 >2014-01-30 03:39:51,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 61647c11 >2014-01-30 03:39:51,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@354c69eb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3af5b335}, log id: 61647c11 >2014-01-30 03:39:54,167 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:39:56,150 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-32) [18099453] No up server in cluster >2014-01-30 03:39:56,150 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-32) [18099453] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:39:56,153 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-32) [18099453] No up server in cluster >2014-01-30 03:39:56,153 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-32) [18099453] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:39:56,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 4352ca44 >2014-01-30 03:39:56,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23ea519d >2014-01-30 03:39:56,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 23ea519d >2014-01-30 03:39:56,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5244990c >2014-01-30 03:39:56,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4352ca44 >2014-01-30 03:39:57,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b9da3e9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95c2505}, log id: 5244990c >2014-01-30 03:39:59,188 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:40:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-63) [23452111] Autorecovering 1 hosts >2014-01-30 03:40:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-63) [23452111] Autorecovering hosts id: 80dfb2ba-85ca-41d0-9af5-8468c89e2354, name : host1 >2014-01-30 03:40:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-63) [1a184195] Lock Acquired to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 03:40:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-63) [1a184195] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:40:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-63) [1a184195] Before acquiring lock in order to prevent monitoring for host host1 from data-center Default >2014-01-30 03:40:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-63) [1a184195] Lock acquired, from now a monitoring of host will be skipped for host host1 from data-center Default >2014-01-30 03:40:00,022 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-63) [1a184195] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=Unassigned, nonOperationalReason=NONE), log id: 3f4bbc5 >2014-01-30 03:40:00,027 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-63) [1a184195] FINISH, SetVdsStatusVDSCommand, log id: 3f4bbc5 >2014-01-30 03:40:00,031 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-63) [1a184195] START, ActivateVdsVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 64722684 >2014-01-30 03:40:00,095 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-63) [1a184195] START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, vds=Host[host1]), log id: 2482ac7c >2014-01-30 03:40:00,108 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-63) [1a184195] FINISH, GetHardwareInfoVDSCommand, log id: 2482ac7c >2014-01-30 03:40:00,143 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-63) [607a0db2] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:40:00,146 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-63) [607a0db2] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=NonOperational, nonOperationalReason=NETWORK_UNREACHABLE), log id: 8fa2354 >2014-01-30 03:40:00,149 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-63) [607a0db2] FINISH, SetVdsStatusVDSCommand, log id: 8fa2354 >2014-01-30 03:40:00,153 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-63) [607a0db2] Host host1 is set to Non-Operational, it is missing the following networks: ovirtmgmt >2014-01-30 03:40:00,159 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-63) [607a0db2] Correlation ID: 607a0db2, Job ID: 60565f5f-77cc-42e9-93f6-e025351573f7, Call Stack: null, Custom Event ID: -1, Message: Host host1 does not comply with the cluster test_1 networks, the following networks are missing on host: 'ovirtmgmt' >2014-01-30 03:40:00,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [607a0db2] START, GlusterServersListVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 72e5a26f >2014-01-30 03:40:00,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [607a0db2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.220:CONNECTED, 10.70.37.158:CONNECTED], log id: 72e5a26f >2014-01-30 03:40:00,658 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:40:00,660 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, ActivateVdsVDSCommand, return: Host[host1], log id: 64722684 >2014-01-30 03:40:00,688 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] Activate finished. Lock released. Monitoring can run now for host host1 from data-center Default >2014-01-30 03:40:00,690 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] Lock freed to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 03:40:02,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33d126b1 >2014-01-30 03:40:02,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 33d126b1 >2014-01-30 03:40:02,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18676058 >2014-01-30 03:40:02,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa326c61, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc8151b6}, log id: 18676058 >2014-01-30 03:40:04,215 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:40:07,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 357839f5 >2014-01-30 03:40:08,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 357839f5 >2014-01-30 03:40:08,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d4f5ded >2014-01-30 03:40:08,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@784ae36b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d943b8a7}, log id: 4d4f5ded >2014-01-30 03:40:09,233 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:40:13,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5de37c3 >2014-01-30 03:40:14,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5de37c3 >2014-01-30 03:40:14,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a148ebb >2014-01-30 03:40:14,255 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:40:14,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bc2924e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1ff6057}, log id: 6a148ebb >2014-01-30 03:40:19,278 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:40:19,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68b3565f >2014-01-30 03:40:20,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 68b3565f >2014-01-30 03:40:20,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4fd418fe >2014-01-30 03:40:20,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec8779b3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcdfa734}, log id: 4fd418fe >2014-01-30 03:40:24,297 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:40:25,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c2bf5c5 >2014-01-30 03:40:25,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2c2bf5c5 >2014-01-30 03:40:25,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 486283a4 >2014-01-30 03:40:26,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cca0b23, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3b6d029}, log id: 486283a4 >2014-01-30 03:40:29,316 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:40:31,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7fe73f9e >2014-01-30 03:40:31,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7fe73f9e >2014-01-30 03:40:31,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ed82ab8 >2014-01-30 03:40:31,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f79835a8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d3a8853}, log id: 6ed82ab8 >2014-01-30 03:40:34,340 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:40:37,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e744edc >2014-01-30 03:40:37,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1e744edc >2014-01-30 03:40:37,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29e7bccb >2014-01-30 03:40:37,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ca9c881, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e94546e4}, log id: 29e7bccb >2014-01-30 03:40:39,359 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:40:42,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: bcb1d54 >2014-01-30 03:40:43,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: bcb1d54 >2014-01-30 03:40:43,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 73893898 >2014-01-30 03:40:43,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1694057d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80b4b01f}, log id: 73893898 >2014-01-30 03:40:44,382 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:40:48,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e2b382b >2014-01-30 03:40:49,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3e2b382b >2014-01-30 03:40:49,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 642b4326 >2014-01-30 03:40:49,403 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:40:49,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff474489, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f618c6fa}, log id: 642b4326 >2014-01-30 03:40:54,423 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:40:54,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d3e21c0 >2014-01-30 03:40:54,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1d3e21c0 >2014-01-30 03:40:54,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4bb9040d >2014-01-30 03:40:55,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@beeed5f4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2342cb54}, log id: 4bb9040d >2014-01-30 03:40:56,874 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-83) [622832bf] No up server in cluster >2014-01-30 03:40:56,874 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-83) [622832bf] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:40:56,877 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-83) [622832bf] No up server in cluster >2014-01-30 03:40:56,878 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-83) [622832bf] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:40:56,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: c8483c9 >2014-01-30 03:40:57,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: c8483c9 >2014-01-30 03:40:59,444 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:41:00,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42eb04c4 >2014-01-30 03:41:00,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 42eb04c4 >2014-01-30 03:41:00,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60a94235 >2014-01-30 03:41:01,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d926359, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6124bc16}, log id: 60a94235 >2014-01-30 03:41:04,467 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:41:06,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3698a95d >2014-01-30 03:41:06,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3698a95d >2014-01-30 03:41:06,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41e6485 >2014-01-30 03:41:06,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@880caf2c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@411a14c1}, log id: 41e6485 >2014-01-30 03:41:09,483 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:41:11,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 526a18a3 >2014-01-30 03:41:12,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 526a18a3 >2014-01-30 03:41:12,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35e6849d >2014-01-30 03:41:12,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8336d834, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d130a9e}, log id: 35e6849d >2014-01-30 03:41:14,505 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:41:17,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ca99266 >2014-01-30 03:41:18,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4ca99266 >2014-01-30 03:41:18,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 47c52f9b >2014-01-30 03:41:18,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50f1bb27, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@395285}, log id: 47c52f9b >2014-01-30 03:41:19,529 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:41:23,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2038ab17 >2014-01-30 03:41:24,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2038ab17 >2014-01-30 03:41:24,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59136be9 >2014-01-30 03:41:24,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e83173b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85103ea6}, log id: 59136be9 >2014-01-30 03:41:24,546 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-73) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:41:29,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 227502d0 >2014-01-30 03:41:29,564 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-4) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:41:29,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 227502d0 >2014-01-30 03:41:29,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 109e144a >2014-01-30 03:41:30,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75a01686, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96a82651}, log id: 109e144a >2014-01-30 03:41:34,587 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:41:35,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43629c57 >2014-01-30 03:41:35,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43629c57 >2014-01-30 03:41:35,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a4cb3fe >2014-01-30 03:41:35,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9273b546, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32cdf98e}, log id: 7a4cb3fe >2014-01-30 03:41:39,611 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:41:40,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e1861cf >2014-01-30 03:41:41,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3e1861cf >2014-01-30 03:41:41,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 351d7ed5 >2014-01-30 03:41:41,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35510e68, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ff69369}, log id: 351d7ed5 >2014-01-30 03:41:44,633 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:41:46,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24c133df >2014-01-30 03:41:47,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 24c133df >2014-01-30 03:41:47,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 771e9cc >2014-01-30 03:41:47,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d60b857e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f55aa4c9}, log id: 771e9cc >2014-01-30 03:41:49,655 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-39) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:41:52,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 274e9694 >2014-01-30 03:41:53,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 274e9694 >2014-01-30 03:41:53,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b0d34b6 >2014-01-30 03:41:53,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@465c659e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94fe7407}, log id: 1b0d34b6 >2014-01-30 03:41:54,675 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:41:57,695 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-77) [7c43042] No up server in cluster >2014-01-30 03:41:57,696 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-77) [7c43042] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:41:57,699 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-77) [7c43042] No up server in cluster >2014-01-30 03:41:57,699 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-77) [7c43042] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:41:57,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6464ffc3 >2014-01-30 03:41:58,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 6464ffc3 >2014-01-30 03:41:58,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42cc56a7 >2014-01-30 03:41:58,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 42cc56a7 >2014-01-30 03:41:58,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a8e7b80 >2014-01-30 03:41:59,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b95cc6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b67f754}, log id: 6a8e7b80 >2014-01-30 03:41:59,695 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:42:04,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ec6ab0e >2014-01-30 03:42:04,723 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:42:04,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6ec6ab0e >2014-01-30 03:42:04,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4748bf2e >2014-01-30 03:42:05,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffb72128, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@787bf9e4}, log id: 4748bf2e >2014-01-30 03:42:09,740 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:42:10,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3343c18f >2014-01-30 03:42:10,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3343c18f >2014-01-30 03:42:10,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e0b0fa1 >2014-01-30 03:42:10,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a49c93a2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66a7f443}, log id: 4e0b0fa1 >2014-01-30 03:42:14,759 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:42:15,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 28805d97 >2014-01-30 03:42:16,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 28805d97 >2014-01-30 03:42:16,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c1485f1 >2014-01-30 03:42:16,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5816af15, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5732d70e}, log id: 5c1485f1 >2014-01-30 03:42:19,781 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:42:21,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27c7ef0f >2014-01-30 03:42:22,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 27c7ef0f >2014-01-30 03:42:22,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6de4f4ad >2014-01-30 03:42:22,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6dc8af31, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1204d23}, log id: 6de4f4ad >2014-01-30 03:42:24,804 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:42:27,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23c3fb65 >2014-01-30 03:42:28,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 23c3fb65 >2014-01-30 03:42:28,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e00799 >2014-01-30 03:42:28,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc2945a0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5094069}, log id: 2e00799 >2014-01-30 03:42:29,825 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:42:33,191 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-7) [631bc2a6] Start refreshing all users data >2014-01-30 03:42:33,250 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-81) [5c437990] Attempting to update VMs/Templates Ovf. >2014-01-30 03:42:33,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c534209 >2014-01-30 03:42:33,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c534209 >2014-01-30 03:42:33,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f2bf7d5 >2014-01-30 03:42:34,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15c11077, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b74f633}, log id: 5f2bf7d5 >2014-01-30 03:42:34,846 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:42:39,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 727ca976 >2014-01-30 03:42:39,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 727ca976 >2014-01-30 03:42:39,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b1e2786 >2014-01-30 03:42:39,869 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:42:39,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8121d2ce, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65197398}, log id: 5b1e2786 >2014-01-30 03:42:44,888 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:42:45,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4519d5b1 >2014-01-30 03:42:45,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4519d5b1 >2014-01-30 03:42:45,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1698e6dd >2014-01-30 03:42:45,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@707dc1e1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@172dc908}, log id: 1698e6dd >2014-01-30 03:42:49,908 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-28) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:42:50,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ed49eb3 >2014-01-30 03:42:51,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: ed49eb3 >2014-01-30 03:42:51,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: fb10349 >2014-01-30 03:42:51,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bedd71ac, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bc65068}, log id: fb10349 >2014-01-30 03:42:54,930 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:42:56,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c6a732e >2014-01-30 03:42:57,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2c6a732e >2014-01-30 03:42:57,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 45bc0269 >2014-01-30 03:42:57,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84915115, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e15f0459}, log id: 45bc0269 >2014-01-30 03:42:58,499 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-20) No up server in cluster >2014-01-30 03:42:58,499 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-20) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:42:58,501 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-20) No up server in cluster >2014-01-30 03:42:58,501 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-20) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:42:58,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 4af22306 >2014-01-30 03:42:59,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4af22306 >2014-01-30 03:42:59,952 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:43:02,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12e3f079 >2014-01-30 03:43:02,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 12e3f079 >2014-01-30 03:43:02,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b4c8977 >2014-01-30 03:43:03,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@960340c4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ced1307}, log id: b4c8977 >2014-01-30 03:43:04,972 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:43:08,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71dd7fa5 >2014-01-30 03:43:08,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 71dd7fa5 >2014-01-30 03:43:08,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5bdabdd7 >2014-01-30 03:43:08,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@381a050, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5781860e}, log id: 5bdabdd7 >2014-01-30 03:43:09,995 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:43:14,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30ccd90e >2014-01-30 03:43:14,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 30ccd90e >2014-01-30 03:43:14,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6879229a >2014-01-30 03:43:14,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1fafc852, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@548e753b}, log id: 6879229a >2014-01-30 03:43:15,017 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:43:19,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ceb59d5 >2014-01-30 03:43:20,042 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:43:20,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1ceb59d5 >2014-01-30 03:43:20,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f83c6ff >2014-01-30 03:43:20,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3670e8af, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@979017fb}, log id: 3f83c6ff >2014-01-30 03:43:25,065 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:43:25,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b5f2ce2 >2014-01-30 03:43:26,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7b5f2ce2 >2014-01-30 03:43:26,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d8bf442 >2014-01-30 03:43:26,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c78aad76, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6558888}, log id: d8bf442 >2014-01-30 03:43:30,085 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:43:31,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d048582 >2014-01-30 03:43:31,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6d048582 >2014-01-30 03:43:31,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5dc91b42 >2014-01-30 03:43:32,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f06aeac7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eea456c4}, log id: 5dc91b42 >2014-01-30 03:43:35,106 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:43:37,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68e60932 >2014-01-30 03:43:37,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 68e60932 >2014-01-30 03:43:37,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e60e166 >2014-01-30 03:43:37,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95ba0e50, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93fecc49}, log id: 2e60e166 >2014-01-30 03:43:40,128 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-20) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:43:43,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6118a4dd >2014-01-30 03:43:43,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6118a4dd >2014-01-30 03:43:43,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b95746d >2014-01-30 03:43:43,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf0a1645, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf71a7d3}, log id: 3b95746d >2014-01-30 03:43:45,150 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:43:48,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 131638e9 >2014-01-30 03:43:49,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 131638e9 >2014-01-30 03:43:49,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 529bfbf9 >2014-01-30 03:43:49,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf55e768, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9817e016}, log id: 529bfbf9 >2014-01-30 03:43:50,170 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:43:54,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7456cc19 >2014-01-30 03:43:55,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7456cc19 >2014-01-30 03:43:55,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2290ee05 >2014-01-30 03:43:55,192 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:43:55,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48325d98, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a416b1ac}, log id: 2290ee05 >2014-01-30 03:43:59,323 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2014-01-30 03:43:59,323 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:43:59,326 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2014-01-30 03:43:59,326 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:43:59,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 59baf568 >2014-01-30 03:44:00,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 59baf568 >2014-01-30 03:44:00,211 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:44:00,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d04ec1b >2014-01-30 03:44:00,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4d04ec1b >2014-01-30 03:44:00,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31654be2 >2014-01-30 03:44:01,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@237d5afc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d322309}, log id: 31654be2 >2014-01-30 03:44:05,230 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:44:06,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 47f5025f >2014-01-30 03:44:06,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 47f5025f >2014-01-30 03:44:06,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74f6c02b >2014-01-30 03:44:07,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad17fdb0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23dfde04}, log id: 74f6c02b >2014-01-30 03:44:10,251 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:44:12,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5aa69181 >2014-01-30 03:44:12,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5aa69181 >2014-01-30 03:44:12,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b5c4cf0 >2014-01-30 03:44:12,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c85b41, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@192420c4}, log id: 4b5c4cf0 >2014-01-30 03:44:15,273 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:44:17,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 537238a >2014-01-30 03:44:18,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 537238a >2014-01-30 03:44:18,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37a31444 >2014-01-30 03:44:18,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7feb570, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dba45d40}, log id: 37a31444 >2014-01-30 03:44:20,291 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:44:23,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 135aaddb >2014-01-30 03:44:24,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 135aaddb >2014-01-30 03:44:24,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c04ac3f >2014-01-30 03:44:24,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6eb55a3d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c084ea4f}, log id: 3c04ac3f >2014-01-30 03:44:25,308 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:44:29,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 734e6e27 >2014-01-30 03:44:30,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 734e6e27 >2014-01-30 03:44:30,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6fa2d9a9 >2014-01-30 03:44:30,327 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:44:30,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cdf5338e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98ea7a9d}, log id: 6fa2d9a9 >2014-01-30 03:44:35,345 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:44:35,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d487e8e >2014-01-30 03:44:35,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1d487e8e >2014-01-30 03:44:35,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56d0700f >2014-01-30 03:44:36,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7feedca8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2175781f}, log id: 56d0700f >2014-01-30 03:44:40,368 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:44:41,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: bdb15e >2014-01-30 03:44:41,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: bdb15e >2014-01-30 03:44:41,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1861de09 >2014-01-30 03:44:41,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27fb8e5e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9e13f0}, log id: 1861de09 >2014-01-30 03:44:42,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 16bf6383 >2014-01-30 03:44:42,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@267129cc, log id: 16bf6383 >2014-01-30 03:44:42,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 4f6f23cb >2014-01-30 03:44:42,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@673b62fb, log id: 4f6f23cb >2014-01-30 03:44:45,388 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:44:47,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53ff88e0 >2014-01-30 03:44:47,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 53ff88e0 >2014-01-30 03:44:47,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a25834d >2014-01-30 03:44:47,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93dbd9b6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccfd4098}, log id: 1a25834d >2014-01-30 03:44:50,408 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-68) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:44:52,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5952a9e0 >2014-01-30 03:44:53,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5952a9e0 >2014-01-30 03:44:53,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 601cb702 >2014-01-30 03:44:53,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75e9806a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65190d31}, log id: 601cb702 >2014-01-30 03:44:55,431 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:44:58,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5429c0ec >2014-01-30 03:44:59,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5429c0ec >2014-01-30 03:44:59,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7794f6a0 >2014-01-30 03:44:59,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2598cbb4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e504c83}, log id: 7794f6a0 >2014-01-30 03:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-40) [4237ee18] Autorecovering 1 hosts >2014-01-30 03:45:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-40) [4237ee18] Autorecovering hosts id: 80dfb2ba-85ca-41d0-9af5-8468c89e2354, name : host1 >2014-01-30 03:45:00,011 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-40) [96d8ec2] Lock Acquired to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 03:45:00,011 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-40) [96d8ec2] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:45:00,011 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-40) [96d8ec2] Before acquiring lock in order to prevent monitoring for host host1 from data-center Default >2014-01-30 03:45:00,011 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-40) [96d8ec2] Lock acquired, from now a monitoring of host will be skipped for host host1 from data-center Default >2014-01-30 03:45:00,016 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-40) [96d8ec2] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=Unassigned, nonOperationalReason=NONE), log id: 14434b48 >2014-01-30 03:45:00,020 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-40) [96d8ec2] FINISH, SetVdsStatusVDSCommand, log id: 14434b48 >2014-01-30 03:45:00,023 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-40) [96d8ec2] START, ActivateVdsVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 6a7b4b8b >2014-01-30 03:45:00,109 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-40) [96d8ec2] START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, vds=Host[host1]), log id: 2fd76195 >2014-01-30 03:45:00,123 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-40) [96d8ec2] FINISH, GetHardwareInfoVDSCommand, log id: 2fd76195 >2014-01-30 03:45:00,161 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-40) [6c1e983e] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:45:00,163 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-40) [6c1e983e] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=NonOperational, nonOperationalReason=NETWORK_UNREACHABLE), log id: 78fed8a7 >2014-01-30 03:45:00,168 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-40) [6c1e983e] FINISH, SetVdsStatusVDSCommand, log id: 78fed8a7 >2014-01-30 03:45:00,175 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-23) [2517ed6c] No up server in cluster >2014-01-30 03:45:00,175 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-40) [6c1e983e] Host host1 is set to Non-Operational, it is missing the following networks: ovirtmgmt >2014-01-30 03:45:00,175 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:45:00,178 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-23) [2517ed6c] No up server in cluster >2014-01-30 03:45:00,178 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:45:00,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e5715a8 >2014-01-30 03:45:00,187 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-40) [6c1e983e] Correlation ID: 6c1e983e, Job ID: 9e724826-9f73-4bb1-b164-0083ee433cf6, Call Stack: null, Custom Event ID: -1, Message: Host host1 does not comply with the cluster test_1 networks, the following networks are missing on host: 'ovirtmgmt' >2014-01-30 03:45:00,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [6c1e983e] START, GlusterServersListVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 1bac61b3 >2014-01-30 03:45:00,452 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-20) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:45:00,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [6c1e983e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.220:CONNECTED, 10.70.37.158:CONNECTED], log id: 1bac61b3 >2014-01-30 03:45:00,681 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:45:00,682 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, ActivateVdsVDSCommand, return: Host[host1], log id: 6a7b4b8b >2014-01-30 03:45:00,703 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] Activate finished. Lock released. Monitoring can run now for host host1 from data-center Default >2014-01-30 03:45:00,704 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] Lock freed to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 03:45:00,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 7e5715a8 >2014-01-30 03:45:04,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d5b6047 >2014-01-30 03:45:04,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2d5b6047 >2014-01-30 03:45:04,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7be88104 >2014-01-30 03:45:05,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f61ad2ba, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d80e9430}, log id: 7be88104 >2014-01-30 03:45:05,475 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:45:10,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43dfa2cf >2014-01-30 03:45:10,495 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:45:10,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43dfa2cf >2014-01-30 03:45:10,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6364eb16 >2014-01-30 03:45:11,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9a41879, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@338fff94}, log id: 6364eb16 >2014-01-30 03:45:15,515 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:45:16,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 85f6a23 >2014-01-30 03:45:16,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 85f6a23 >2014-01-30 03:45:16,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48beb9a5 >2014-01-30 03:45:16,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@764994ba, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80044a4d}, log id: 48beb9a5 >2014-01-30 03:45:20,536 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:45:21,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67ade5e6 >2014-01-30 03:45:22,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 67ade5e6 >2014-01-30 03:45:22,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a6e2855 >2014-01-30 03:45:22,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a0f28b6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5c344fa}, log id: 3a6e2855 >2014-01-30 03:45:25,557 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:45:27,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40d75e50 >2014-01-30 03:45:28,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 40d75e50 >2014-01-30 03:45:28,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ef920c9 >2014-01-30 03:45:28,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e8428c0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@635dd87e}, log id: 6ef920c9 >2014-01-30 03:45:30,575 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:45:33,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3759cb73 >2014-01-30 03:45:34,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3759cb73 >2014-01-30 03:45:34,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4167c9ca >2014-01-30 03:45:34,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99652715, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22cca462}, log id: 4167c9ca >2014-01-30 03:45:35,595 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:45:39,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36a9734c >2014-01-30 03:45:39,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 36a9734c >2014-01-30 03:45:39,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2767ba21 >2014-01-30 03:45:40,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81ecc31d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9a074e3}, log id: 2767ba21 >2014-01-30 03:45:40,617 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:45:45,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 716ca323 >2014-01-30 03:45:45,636 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:45:45,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 716ca323 >2014-01-30 03:45:45,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ec5de3c >2014-01-30 03:45:46,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@395478b8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54415ef0}, log id: 2ec5de3c >2014-01-30 03:45:50,657 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:45:51,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74ef6cd2 >2014-01-30 03:45:51,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 74ef6cd2 >2014-01-30 03:45:51,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36e31928 >2014-01-30 03:45:51,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b142d51, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed40b92c}, log id: 36e31928 >2014-01-30 03:45:55,677 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:45:56,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6bbaa844 >2014-01-30 03:45:57,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6bbaa844 >2014-01-30 03:45:57,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e6fb267 >2014-01-30 03:45:57,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b688e71, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ab5a011}, log id: 3e6fb267 >2014-01-30 03:46:00,698 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:46:00,996 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-62) [1449451c] No up server in cluster >2014-01-30 03:46:00,996 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-62) [1449451c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:46:00,999 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-62) [1449451c] No up server in cluster >2014-01-30 03:46:00,999 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-62) [1449451c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:46:01,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 12582b0d >2014-01-30 03:46:01,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 12582b0d >2014-01-30 03:46:02,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21f2d744 >2014-01-30 03:46:03,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 21f2d744 >2014-01-30 03:46:03,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5608da1f >2014-01-30 03:46:03,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d311499, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5601bd88}, log id: 5608da1f >2014-01-30 03:46:05,720 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:46:08,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 390a014d >2014-01-30 03:46:08,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 390a014d >2014-01-30 03:46:08,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c702429 >2014-01-30 03:46:09,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57789b24, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd9ad591}, log id: 6c702429 >2014-01-30 03:46:10,744 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:46:14,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a1bf42d >2014-01-30 03:46:14,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2a1bf42d >2014-01-30 03:46:14,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 148d883f >2014-01-30 03:46:15,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f588c8cc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41918ec3}, log id: 148d883f >2014-01-30 03:46:15,785 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:46:20,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 603b143c >2014-01-30 03:46:20,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 603b143c >2014-01-30 03:46:20,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7cc0b568 >2014-01-30 03:46:20,806 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:46:20,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95648430, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6581c927}, log id: 7cc0b568 >2014-01-30 03:46:25,827 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:46:26,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6924673a >2014-01-30 03:46:26,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6924673a >2014-01-30 03:46:26,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a69b6d4 >2014-01-30 03:46:26,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41a0182b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97d3afca}, log id: a69b6d4 >2014-01-30 03:46:30,849 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:46:31,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a2b4eb9 >2014-01-30 03:46:32,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3a2b4eb9 >2014-01-30 03:46:32,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e181ff >2014-01-30 03:46:32,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ae1fcf3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5180676}, log id: 3e181ff >2014-01-30 03:46:35,871 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-50) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:46:37,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10da05ba >2014-01-30 03:46:38,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 10da05ba >2014-01-30 03:46:38,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37808e8b >2014-01-30 03:46:38,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [163d00df] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a0d1b22, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@282e58ed}, log id: 37808e8b >2014-01-30 03:46:40,892 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:46:43,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2377b591 >2014-01-30 03:46:43,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2377b591 >2014-01-30 03:46:43,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ff882bc >2014-01-30 03:46:44,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@734c0128, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d35129a5}, log id: 7ff882bc >2014-01-30 03:46:45,911 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:46:49,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5071b637 >2014-01-30 03:46:49,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5071b637 >2014-01-30 03:46:49,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d439f97 >2014-01-30 03:46:50,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@970adc23, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f767c639}, log id: 6d439f97 >2014-01-30 03:46:50,934 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-68) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:46:55,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7471e799 >2014-01-30 03:46:55,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7471e799 >2014-01-30 03:46:55,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3510ffb >2014-01-30 03:46:55,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be39a91b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@740d6cc}, log id: 3510ffb >2014-01-30 03:46:55,953 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:47:00,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 590b7eb7 >2014-01-30 03:47:00,973 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:47:01,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 590b7eb7 >2014-01-30 03:47:01,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ff201f3 >2014-01-30 03:47:01,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2dc2713, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e917a9c}, log id: 5ff201f3 >2014-01-30 03:47:01,851 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-21) [3dfe147] No up server in cluster >2014-01-30 03:47:01,851 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-21) [3dfe147] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:47:01,854 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-21) [3dfe147] No up server in cluster >2014-01-30 03:47:01,855 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-21) [3dfe147] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:47:01,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 51de6053 >2014-01-30 03:47:02,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 51de6053 >2014-01-30 03:47:05,990 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:47:06,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7407e786 >2014-01-30 03:47:07,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7407e786 >2014-01-30 03:47:07,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16b32a1f >2014-01-30 03:47:07,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e99c2e2c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85b1df47}, log id: 16b32a1f >2014-01-30 03:47:11,013 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:47:12,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c17e6d3 >2014-01-30 03:47:12,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4c17e6d3 >2014-01-30 03:47:12,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 757ddb7b >2014-01-30 03:47:13,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d2c8c34, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ca4e5e6}, log id: 757ddb7b >2014-01-30 03:47:16,032 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:47:18,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 362cfebc >2014-01-30 03:47:18,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 362cfebc >2014-01-30 03:47:18,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e7372ef >2014-01-30 03:47:19,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72f824c4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51aa10fd}, log id: 7e7372ef >2014-01-30 03:47:21,048 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:47:24,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 517cb96e >2014-01-30 03:47:24,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 517cb96e >2014-01-30 03:47:24,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43c817d7 >2014-01-30 03:47:24,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac3e3b92, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f784389b}, log id: 43c817d7 >2014-01-30 03:47:26,070 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:47:29,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b65973e >2014-01-30 03:47:30,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1b65973e >2014-01-30 03:47:30,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51d45de5 >2014-01-30 03:47:30,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba7d509d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6edac0}, log id: 51d45de5 >2014-01-30 03:47:31,091 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:47:36,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 642a3e49 >2014-01-30 03:47:36,110 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:47:36,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 642a3e49 >2014-01-30 03:47:36,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2429adb6 >2014-01-30 03:47:36,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5610006, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b23aa649}, log id: 2429adb6 >2014-01-30 03:47:41,129 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:47:41,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c6ecb28 >2014-01-30 03:47:42,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4c6ecb28 >2014-01-30 03:47:42,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4fe478e2 >2014-01-30 03:47:42,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31e428cc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fa1c62d}, log id: 4fe478e2 >2014-01-30 03:47:46,147 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:47:47,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41676e01 >2014-01-30 03:47:48,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 41676e01 >2014-01-30 03:47:48,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58c3b8c0 >2014-01-30 03:47:48,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffd834f0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fdab1f6}, log id: 58c3b8c0 >2014-01-30 03:47:51,167 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:47:53,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3be13e02 >2014-01-30 03:47:53,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3be13e02 >2014-01-30 03:47:53,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1837f46b >2014-01-30 03:47:54,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4370e8e0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb45e1c4}, log id: 1837f46b >2014-01-30 03:47:56,189 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-73) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:47:59,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23e7c8fb >2014-01-30 03:47:59,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 23e7c8fb >2014-01-30 03:47:59,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 164a276d >2014-01-30 03:48:00,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba9b0b76, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e74324c7}, log id: 164a276d >2014-01-30 03:48:01,209 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-45) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:48:02,709 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-82) [4eafa082] No up server in cluster >2014-01-30 03:48:02,709 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-82) [4eafa082] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:48:02,711 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-82) [4eafa082] No up server in cluster >2014-01-30 03:48:02,711 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-82) [4eafa082] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:48:02,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 36630c72 >2014-01-30 03:48:03,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 36630c72 >2014-01-30 03:48:05,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a7526ff >2014-01-30 03:48:05,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6a7526ff >2014-01-30 03:48:05,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6eab339 >2014-01-30 03:48:05,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae61e3bd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25eb90d2}, log id: 6eab339 >2014-01-30 03:48:06,231 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:48:10,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d4cb967 >2014-01-30 03:48:11,250 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:48:11,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: d4cb967 >2014-01-30 03:48:11,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64039cc7 >2014-01-30 03:48:11,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69ad55fb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81516ed5}, log id: 64039cc7 >2014-01-30 03:48:16,271 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:48:16,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11485c8e >2014-01-30 03:48:17,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 11485c8e >2014-01-30 03:48:17,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26ce3c00 >2014-01-30 03:48:17,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab3dca17, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4cace852}, log id: 26ce3c00 >2014-01-30 03:48:21,292 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:48:22,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10b52f5c >2014-01-30 03:48:23,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 10b52f5c >2014-01-30 03:48:23,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18f286b3 >2014-01-30 03:48:23,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96a261d8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8632e3ec}, log id: 18f286b3 >2014-01-30 03:48:26,315 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:48:28,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f9115f >2014-01-30 03:48:28,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5f9115f >2014-01-30 03:48:28,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 740c2cea >2014-01-30 03:48:29,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc5ea1c3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10f3d28a}, log id: 740c2cea >2014-01-30 03:48:31,335 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:48:34,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 348b6d2e >2014-01-30 03:48:34,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 348b6d2e >2014-01-30 03:48:34,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4037b88b >2014-01-30 03:48:34,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd5f7205, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2fdce6d}, log id: 4037b88b >2014-01-30 03:48:36,355 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:48:39,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a8d241 >2014-01-30 03:48:40,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5a8d241 >2014-01-30 03:48:40,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b0ab7e7 >2014-01-30 03:48:40,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@230c1fed, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@647f0650}, log id: 3b0ab7e7 >2014-01-30 03:48:41,373 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-45) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:48:45,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3425d918 >2014-01-30 03:48:46,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3425d918 >2014-01-30 03:48:46,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ba98ac2 >2014-01-30 03:48:46,392 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:48:46,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15c41f5f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd944ba8}, log id: 2ba98ac2 >2014-01-30 03:48:51,409 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:48:51,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6db417a6 >2014-01-30 03:48:52,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6db417a6 >2014-01-30 03:48:52,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a115f39 >2014-01-30 03:48:52,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29390be7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d9cc569}, log id: 3a115f39 >2014-01-30 03:48:56,429 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:48:57,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2cebed12 >2014-01-30 03:48:57,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2cebed12 >2014-01-30 03:48:57,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a932155 >2014-01-30 03:48:58,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7358ff7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d38cdd8}, log id: 4a932155 >2014-01-30 03:49:01,450 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:49:03,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b81b976 >2014-01-30 03:49:03,554 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) [38d7b473] No up server in cluster >2014-01-30 03:49:03,554 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) [38d7b473] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:49:03,556 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) [38d7b473] No up server in cluster >2014-01-30 03:49:03,557 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) [38d7b473] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:49:03,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 76d3e15f >2014-01-30 03:49:03,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6b81b976 >2014-01-30 03:49:03,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f3354f9 >2014-01-30 03:49:03,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73d99ecc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46ecbfed}, log id: f3354f9 >2014-01-30 03:49:04,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 76d3e15f >2014-01-30 03:49:06,472 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:49:08,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b0afcfd >2014-01-30 03:49:09,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2b0afcfd >2014-01-30 03:49:09,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79507375 >2014-01-30 03:49:09,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e6a9ed1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b57e532c}, log id: 79507375 >2014-01-30 03:49:11,494 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:49:14,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50765052 >2014-01-30 03:49:15,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 50765052 >2014-01-30 03:49:15,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53d8df24 >2014-01-30 03:49:15,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@315fea37, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c8dfa52}, log id: 53d8df24 >2014-01-30 03:49:16,513 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-73) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:49:20,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 655d5a71 >2014-01-30 03:49:21,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 655d5a71 >2014-01-30 03:49:21,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3dcf962b >2014-01-30 03:49:21,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de4611dd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f1c837d}, log id: 3dcf962b >2014-01-30 03:49:21,537 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:49:26,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 447d8aa6 >2014-01-30 03:49:26,558 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:49:26,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 447d8aa6 >2014-01-30 03:49:26,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 84c6ee1 >2014-01-30 03:49:27,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a4247b8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7d6a161}, log id: 84c6ee1 >2014-01-30 03:49:31,579 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:49:32,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b7fc1bf >2014-01-30 03:49:32,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b7fc1bf >2014-01-30 03:49:32,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2633f941 >2014-01-30 03:49:32,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@baaf5ce0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6174776}, log id: 2633f941 >2014-01-30 03:49:36,600 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-20) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:49:38,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 63e69ef6 >2014-01-30 03:49:38,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 63e69ef6 >2014-01-30 03:49:38,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2305d1ee >2014-01-30 03:49:38,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40b107ab, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b3137ff}, log id: 2305d1ee >2014-01-30 03:49:41,616 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:49:42,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 2ce86e01 >2014-01-30 03:49:43,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2ca8e839, log id: 2ce86e01 >2014-01-30 03:49:43,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 5260d17 >2014-01-30 03:49:43,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6d1aef1f, log id: 5260d17 >2014-01-30 03:49:43,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4cfa4a1d >2014-01-30 03:49:44,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4cfa4a1d >2014-01-30 03:49:44,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ba7b087 >2014-01-30 03:49:44,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51ccbfc1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3093cd0}, log id: 2ba7b087 >2014-01-30 03:49:46,637 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:49:49,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7186b18c >2014-01-30 03:49:50,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7186b18c >2014-01-30 03:49:50,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50b67d03 >2014-01-30 03:49:50,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fed05abe, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1e35d39}, log id: 50b67d03 >2014-01-30 03:49:51,658 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:49:55,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f4766b >2014-01-30 03:49:55,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6f4766b >2014-01-30 03:49:55,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1369bf0d >2014-01-30 03:49:56,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fff4cb78, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@102ff14c}, log id: 1369bf0d >2014-01-30 03:49:56,677 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:50:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-28) Autorecovering 1 hosts >2014-01-30 03:50:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-28) Autorecovering hosts id: 80dfb2ba-85ca-41d0-9af5-8468c89e2354, name : host1 >2014-01-30 03:50:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-28) [4aaa2e29] Lock Acquired to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 03:50:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-28) [4aaa2e29] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:50:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-28) [4aaa2e29] Before acquiring lock in order to prevent monitoring for host host1 from data-center Default >2014-01-30 03:50:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-28) [4aaa2e29] Lock acquired, from now a monitoring of host will be skipped for host host1 from data-center Default >2014-01-30 03:50:00,023 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-28) [4aaa2e29] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=Unassigned, nonOperationalReason=NONE), log id: 1e7f6555 >2014-01-30 03:50:00,028 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-28) [4aaa2e29] FINISH, SetVdsStatusVDSCommand, log id: 1e7f6555 >2014-01-30 03:50:00,033 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-28) [4aaa2e29] START, ActivateVdsVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 33dc5306 >2014-01-30 03:50:00,140 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-28) [4aaa2e29] START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, vds=Host[host1]), log id: 41a518b7 >2014-01-30 03:50:00,153 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-28) [4aaa2e29] FINISH, GetHardwareInfoVDSCommand, log id: 41a518b7 >2014-01-30 03:50:00,187 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-28) [6384ffa] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:50:00,189 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-28) [6384ffa] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=NonOperational, nonOperationalReason=NETWORK_UNREACHABLE), log id: 39fe6b43 >2014-01-30 03:50:00,194 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-28) [6384ffa] FINISH, SetVdsStatusVDSCommand, log id: 39fe6b43 >2014-01-30 03:50:00,200 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-28) [6384ffa] Host host1 is set to Non-Operational, it is missing the following networks: ovirtmgmt >2014-01-30 03:50:00,211 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-28) [6384ffa] Correlation ID: 6384ffa, Job ID: d9a3a9db-393b-48d6-b49b-5c60e0e96745, Call Stack: null, Custom Event ID: -1, Message: Host host1 does not comply with the cluster test_1 networks, the following networks are missing on host: 'ovirtmgmt' >2014-01-30 03:50:00,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [6384ffa] START, GlusterServersListVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 410dd141 >2014-01-30 03:50:00,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [6384ffa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.220:CONNECTED, 10.70.37.158:CONNECTED], log id: 410dd141 >2014-01-30 03:50:00,714 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:50:00,716 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] FINISH, ActivateVdsVDSCommand, return: Host[host1], log id: 33dc5306 >2014-01-30 03:50:00,740 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] Activate finished. Lock released. Monitoring can run now for host host1 from data-center Default >2014-01-30 03:50:00,741 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] Lock freed to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 03:50:01,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15bc9db8 >2014-01-30 03:50:01,697 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-45) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:50:01,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 15bc9db8 >2014-01-30 03:50:01,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d3e96fd >2014-01-30 03:50:02,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f10d3dbc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe11900f}, log id: d3e96fd >2014-01-30 03:50:04,344 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-2) [237643cb] No up server in cluster >2014-01-30 03:50:04,344 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-2) [237643cb] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:50:04,347 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-2) [237643cb] No up server in cluster >2014-01-30 03:50:04,347 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-2) [237643cb] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:50:04,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d8f5d40 >2014-01-30 03:50:05,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 1d8f5d40 >2014-01-30 03:50:06,714 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-56) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:50:07,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b0984e8 >2014-01-30 03:50:07,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7b0984e8 >2014-01-30 03:50:07,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1225f24b >2014-01-30 03:50:07,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b11eb24, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5c27c2d}, log id: 1225f24b >2014-01-30 03:50:11,734 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:50:12,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1dd6708c >2014-01-30 03:50:13,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1dd6708c >2014-01-30 03:50:13,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c916010 >2014-01-30 03:50:13,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25bb8d22, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfbc6efc}, log id: 2c916010 >2014-01-30 03:50:16,755 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:50:18,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e197ddf >2014-01-30 03:50:19,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2e197ddf >2014-01-30 03:50:19,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b2766d2 >2014-01-30 03:50:19,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c53e4f49, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d0da905}, log id: 5b2766d2 >2014-01-30 03:50:21,777 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:50:24,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b41c476 >2014-01-30 03:50:25,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2b41c476 >2014-01-30 03:50:25,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c072b7 >2014-01-30 03:50:25,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@567db336, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6cc9f7bd}, log id: 2c072b7 >2014-01-30 03:50:26,795 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:50:30,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 465cc6fa >2014-01-30 03:50:30,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 465cc6fa >2014-01-30 03:50:30,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 798c2d10 >2014-01-30 03:50:31,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0d8fac7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ed67d8f}, log id: 798c2d10 >2014-01-30 03:50:31,821 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:50:36,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2543df7b >2014-01-30 03:50:36,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2543df7b >2014-01-30 03:50:36,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f58c5e6 >2014-01-30 03:50:36,842 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:50:36,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c390ab5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f7c03a2}, log id: 1f58c5e6 >2014-01-30 03:50:41,859 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:50:42,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7911e5b5 >2014-01-30 03:50:42,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7911e5b5 >2014-01-30 03:50:42,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31ddf165 >2014-01-30 03:50:42,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98e28b22, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d00fce0}, log id: 31ddf165 >2014-01-30 03:50:46,882 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:50:47,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 195b063a >2014-01-30 03:50:48,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 195b063a >2014-01-30 03:50:48,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40c55df2 >2014-01-30 03:50:48,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed55be30, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a66a3afe}, log id: 40c55df2 >2014-01-30 03:50:51,905 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:50:53,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40002d68 >2014-01-30 03:50:54,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 40002d68 >2014-01-30 03:50:54,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5050a6c7 >2014-01-30 03:50:54,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebbf6540, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fae2d376}, log id: 5050a6c7 >2014-01-30 03:50:56,928 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:50:59,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72b88703 >2014-01-30 03:51:00,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 72b88703 >2014-01-30 03:51:00,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2445ddf4 >2014-01-30 03:51:00,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bff0c10b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4b0ca7}, log id: 2445ddf4 >2014-01-30 03:51:01,949 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:51:05,153 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) [28855a44] No up server in cluster >2014-01-30 03:51:05,154 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) [28855a44] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:51:05,157 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) [28855a44] No up server in cluster >2014-01-30 03:51:05,157 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) [28855a44] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:51:05,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 35bd2f30 >2014-01-30 03:51:05,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69887836 >2014-01-30 03:51:05,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 69887836 >2014-01-30 03:51:05,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e728319 >2014-01-30 03:51:05,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 35bd2f30 >2014-01-30 03:51:06,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45eb7212, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@110005dc}, log id: 1e728319 >2014-01-30 03:51:06,972 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:51:11,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 264120af >2014-01-30 03:51:11,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 264120af >2014-01-30 03:51:11,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 277c1578 >2014-01-30 03:51:11,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@735f922e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e75ee981}, log id: 277c1578 >2014-01-30 03:51:11,996 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:51:16,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b8ac15d >2014-01-30 03:51:17,016 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:51:17,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6b8ac15d >2014-01-30 03:51:17,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48cc5c9e >2014-01-30 03:51:17,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55b351c4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c50c55e0}, log id: 48cc5c9e >2014-01-30 03:51:22,041 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:51:22,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2efd0025 >2014-01-30 03:51:23,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2efd0025 >2014-01-30 03:51:23,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48b7c0d3 >2014-01-30 03:51:23,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ed2ef74, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@389de608}, log id: 48b7c0d3 >2014-01-30 03:51:27,059 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:51:28,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16ce3fa6 >2014-01-30 03:51:29,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 16ce3fa6 >2014-01-30 03:51:29,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d01b664 >2014-01-30 03:51:29,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55409244, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6b94034}, log id: 2d01b664 >2014-01-30 03:51:32,082 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:51:34,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18983fb8 >2014-01-30 03:51:34,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 18983fb8 >2014-01-30 03:51:34,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ab932ae >2014-01-30 03:51:35,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2f0f23, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@daf6e675}, log id: 3ab932ae >2014-01-30 03:51:37,103 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:51:40,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2da32c32 >2014-01-30 03:51:40,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2da32c32 >2014-01-30 03:51:40,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c312764 >2014-01-30 03:51:41,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5fe181e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ac9669c}, log id: 3c312764 >2014-01-30 03:51:42,123 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:51:46,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d78a64b >2014-01-30 03:51:46,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: d78a64b >2014-01-30 03:51:46,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54956f0d >2014-01-30 03:51:46,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6d432f3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4bb3baab}, log id: 54956f0d >2014-01-30 03:51:47,146 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:51:51,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f464e3c >2014-01-30 03:51:52,166 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:51:52,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7f464e3c >2014-01-30 03:51:52,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29170430 >2014-01-30 03:51:52,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69f721a9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@861ab8bf}, log id: 29170430 >2014-01-30 03:51:57,188 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:51:57,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49fd1726 >2014-01-30 03:51:58,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 49fd1726 >2014-01-30 03:51:58,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a4b8c5 >2014-01-30 03:51:58,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e56f8f28, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bc94895}, log id: 3a4b8c5 >2014-01-30 03:52:02,210 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-69) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:52:03,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d8cefa9 >2014-01-30 03:52:04,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1d8cefa9 >2014-01-30 03:52:04,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 573219ba >2014-01-30 03:52:04,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7628a9f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff02af3d}, log id: 573219ba >2014-01-30 03:52:05,941 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-2) [237643cb] No up server in cluster >2014-01-30 03:52:05,941 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-2) [237643cb] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:52:05,943 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-2) [237643cb] No up server in cluster >2014-01-30 03:52:05,943 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-2) [237643cb] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:52:05,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 4719829c >2014-01-30 03:52:06,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4719829c >2014-01-30 03:52:07,229 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:52:09,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20231528 >2014-01-30 03:52:09,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 20231528 >2014-01-30 03:52:09,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d54593b >2014-01-30 03:52:10,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69a81bfa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6d64751}, log id: 6d54593b >2014-01-30 03:52:12,250 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:52:15,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12931b2a >2014-01-30 03:52:15,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 12931b2a >2014-01-30 03:52:15,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ff507de >2014-01-30 03:52:15,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec6a767e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e81c033}, log id: 4ff507de >2014-01-30 03:52:17,271 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:52:21,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e379a3a >2014-01-30 03:52:21,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3e379a3a >2014-01-30 03:52:21,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f516bc >2014-01-30 03:52:21,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b233e7b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42a65145}, log id: 2f516bc >2014-01-30 03:52:22,291 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:52:26,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6da34f12 >2014-01-30 03:52:27,311 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:52:27,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6da34f12 >2014-01-30 03:52:27,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4906a477 >2014-01-30 03:52:27,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@599e2867, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65c49d2f}, log id: 4906a477 >2014-01-30 03:52:32,333 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-51) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:52:32,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 342aa6f8 >2014-01-30 03:52:33,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 342aa6f8 >2014-01-30 03:52:33,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59ed8d04 >2014-01-30 03:52:33,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bda015c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21fd0418}, log id: 59ed8d04 >2014-01-30 03:52:37,353 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:52:38,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18d7589a >2014-01-30 03:52:38,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 18d7589a >2014-01-30 03:52:38,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 763d34b4 >2014-01-30 03:52:39,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45b602af, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@251f5c9c}, log id: 763d34b4 >2014-01-30 03:52:42,374 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-69) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:52:44,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d65c255 >2014-01-30 03:52:44,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3d65c255 >2014-01-30 03:52:44,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 618fdbc8 >2014-01-30 03:52:45,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9517ea1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67c7d177}, log id: 618fdbc8 >2014-01-30 03:52:47,395 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:52:50,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3742b09d >2014-01-30 03:52:50,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3742b09d >2014-01-30 03:52:50,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b564ad6 >2014-01-30 03:52:50,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb6991c0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12b23be1}, log id: 5b564ad6 >2014-01-30 03:52:52,415 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:52:55,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e6fc1de >2014-01-30 03:52:56,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4e6fc1de >2014-01-30 03:52:56,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 449a8512 >2014-01-30 03:52:56,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc9ed4d0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb12f951}, log id: 449a8512 >2014-01-30 03:52:57,436 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:53:01,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 483cd73 >2014-01-30 03:53:02,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 483cd73 >2014-01-30 03:53:02,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 201205ee >2014-01-30 03:53:02,454 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:53:02,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59ef606d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca5dc8df}, log id: 201205ee >2014-01-30 03:53:06,760 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) [4376cca4] No up server in cluster >2014-01-30 03:53:06,760 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) [4376cca4] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:53:06,762 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) [4376cca4] No up server in cluster >2014-01-30 03:53:06,762 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) [4376cca4] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:53:06,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f97845c >2014-01-30 03:53:07,471 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:53:07,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 587b568c >2014-01-30 03:53:07,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 3f97845c >2014-01-30 03:53:08,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 587b568c >2014-01-30 03:53:08,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54fca559 >2014-01-30 03:53:08,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79b30c65, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@829e026d}, log id: 54fca559 >2014-01-30 03:53:12,491 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-73) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:53:13,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 103ef21c >2014-01-30 03:53:13,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 103ef21c >2014-01-30 03:53:13,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26350dc8 >2014-01-30 03:53:14,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7cd15631, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72d3619e}, log id: 26350dc8 >2014-01-30 03:53:17,513 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:53:19,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3579c795 >2014-01-30 03:53:19,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3579c795 >2014-01-30 03:53:19,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10db8c2b >2014-01-30 03:53:19,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a4cfd0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8d7ba29}, log id: 10db8c2b >2014-01-30 03:53:22,534 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-68) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:53:25,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49208f90 >2014-01-30 03:53:25,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 49208f90 >2014-01-30 03:53:25,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13ec09d0 >2014-01-30 03:53:25,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ddfc069, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16ed5dff}, log id: 13ec09d0 >2014-01-30 03:53:27,565 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:53:30,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60efe4c3 >2014-01-30 03:53:31,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 60efe4c3 >2014-01-30 03:53:31,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 592e52e4 >2014-01-30 03:53:31,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5433d63e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ed12301}, log id: 592e52e4 >2014-01-30 03:53:32,587 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:53:36,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4940f298 >2014-01-30 03:53:37,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4940f298 >2014-01-30 03:53:37,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77a760ca >2014-01-30 03:53:37,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f296112e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8ef5172}, log id: 77a760ca >2014-01-30 03:53:37,605 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:53:42,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24a19b01 >2014-01-30 03:53:42,627 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:53:43,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 24a19b01 >2014-01-30 03:53:43,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78bdd585 >2014-01-30 03:53:43,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40c5289b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93cb0cb9}, log id: 78bdd585 >2014-01-30 03:53:47,646 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:53:48,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 39a17384 >2014-01-30 03:53:48,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 39a17384 >2014-01-30 03:53:48,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56d34d89 >2014-01-30 03:53:49,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ac7a23, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2767e9fa}, log id: 56d34d89 >2014-01-30 03:53:52,668 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:53:54,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13c16815 >2014-01-30 03:53:54,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 13c16815 >2014-01-30 03:53:54,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 443c0754 >2014-01-30 03:53:54,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f00e61f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48f1681b}, log id: 443c0754 >2014-01-30 03:53:57,691 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:53:59,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a3e5833 >2014-01-30 03:54:00,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2a3e5833 >2014-01-30 03:54:00,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c74c767 >2014-01-30 03:54:00,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7af59170, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@152de3b1}, log id: 2c74c767 >2014-01-30 03:54:02,711 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-56) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:54:05,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6748efa7 >2014-01-30 03:54:06,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6748efa7 >2014-01-30 03:54:06,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65ba0acf >2014-01-30 03:54:06,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5798f2f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fee14bbc}, log id: 65ba0acf >2014-01-30 03:54:07,600 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) [23554188] No up server in cluster >2014-01-30 03:54:07,600 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) [23554188] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:54:07,603 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) [23554188] No up server in cluster >2014-01-30 03:54:07,603 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) [23554188] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:54:07,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: c90f5ed >2014-01-30 03:54:07,732 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:54:08,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: c90f5ed >2014-01-30 03:54:11,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b1678cc >2014-01-30 03:54:12,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1b1678cc >2014-01-30 03:54:12,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33898ce >2014-01-30 03:54:12,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46300515, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e6728a2}, log id: 33898ce >2014-01-30 03:54:12,753 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:54:17,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fc1cb7e >2014-01-30 03:54:17,775 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:54:17,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3fc1cb7e >2014-01-30 03:54:17,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22350cc9 >2014-01-30 03:54:18,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95598374, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c272be05}, log id: 22350cc9 >2014-01-30 03:54:22,795 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:54:23,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b66a0b6 >2014-01-30 03:54:23,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7b66a0b6 >2014-01-30 03:54:23,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 109b2647 >2014-01-30 03:54:23,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@745248a9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c400b1e8}, log id: 109b2647 >2014-01-30 03:54:27,818 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:54:29,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2aa6ec1a >2014-01-30 03:54:29,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2aa6ec1a >2014-01-30 03:54:29,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 63c5c82f >2014-01-30 03:54:29,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd29615e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3847432}, log id: 63c5c82f >2014-01-30 03:54:32,839 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:54:34,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6361d245 >2014-01-30 03:54:35,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6361d245 >2014-01-30 03:54:35,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 243095c1 >2014-01-30 03:54:35,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17871d4b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fffeacb}, log id: 243095c1 >2014-01-30 03:54:37,860 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:54:40,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19133e24 >2014-01-30 03:54:41,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 19133e24 >2014-01-30 03:54:41,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fad9942 >2014-01-30 03:54:41,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e77468bb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8eefd731}, log id: 3fad9942 >2014-01-30 03:54:42,883 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:54:43,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 73268bd6 >2014-01-30 03:54:43,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@62114add, log id: 73268bd6 >2014-01-30 03:54:43,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 5d4a2577 >2014-01-30 03:54:44,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4b211525, log id: 5d4a2577 >2014-01-30 03:54:46,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 351b7770 >2014-01-30 03:54:47,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 351b7770 >2014-01-30 03:54:47,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3218b581 >2014-01-30 03:54:47,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da043da2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c30c6559}, log id: 3218b581 >2014-01-30 03:54:47,906 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:54:52,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: cca2353 >2014-01-30 03:54:52,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: cca2353 >2014-01-30 03:54:52,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e3f0c5 >2014-01-30 03:54:52,930 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:54:53,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61a0ece2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e8c36b7}, log id: 2e3f0c5 >2014-01-30 03:54:57,947 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:54:58,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f704c5a >2014-01-30 03:54:58,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: f704c5a >2014-01-30 03:54:58,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22cc0b72 >2014-01-30 03:54:58,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a15d1bf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fa773be}, log id: 22cc0b72 >2014-01-30 03:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] Autorecovering 1 hosts >2014-01-30 03:55:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-60) [1f57b2f3] Autorecovering hosts id: 80dfb2ba-85ca-41d0-9af5-8468c89e2354, name : host1 >2014-01-30 03:55:00,012 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-60) [15cb8a58] Lock Acquired to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 03:55:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-60) [15cb8a58] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:55:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-60) [15cb8a58] Before acquiring lock in order to prevent monitoring for host host1 from data-center Default >2014-01-30 03:55:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-60) [15cb8a58] Lock acquired, from now a monitoring of host will be skipped for host host1 from data-center Default >2014-01-30 03:55:00,021 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-60) [15cb8a58] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=Unassigned, nonOperationalReason=NONE), log id: 7f1e3fbb >2014-01-30 03:55:00,026 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-60) [15cb8a58] FINISH, SetVdsStatusVDSCommand, log id: 7f1e3fbb >2014-01-30 03:55:00,029 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-60) [15cb8a58] START, ActivateVdsVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 6cb51986 >2014-01-30 03:55:00,085 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-60) [15cb8a58] START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, vds=Host[host1]), log id: 13e33c0e >2014-01-30 03:55:00,099 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-60) [15cb8a58] FINISH, GetHardwareInfoVDSCommand, log id: 13e33c0e >2014-01-30 03:55:00,120 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-60) [2245bc68] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:55:00,122 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-60) [2245bc68] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=NonOperational, nonOperationalReason=NETWORK_UNREACHABLE), log id: 75f896e3 >2014-01-30 03:55:00,128 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-60) [2245bc68] FINISH, SetVdsStatusVDSCommand, log id: 75f896e3 >2014-01-30 03:55:00,132 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-60) [2245bc68] Host host1 is set to Non-Operational, it is missing the following networks: ovirtmgmt >2014-01-30 03:55:00,143 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-60) [2245bc68] Correlation ID: 2245bc68, Job ID: 4c67158f-6ac1-4161-b567-ad7d1fb180b0, Call Stack: null, Custom Event ID: -1, Message: Host host1 does not comply with the cluster test_1 networks, the following networks are missing on host: 'ovirtmgmt' >2014-01-30 03:55:00,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [2245bc68] START, GlusterServersListVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 42bacda5 >2014-01-30 03:55:00,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [2245bc68] FINISH, GlusterServersListVDSCommand, return: [10.70.37.220:CONNECTED, 10.70.37.158:CONNECTED], log id: 42bacda5 >2014-01-30 03:55:00,652 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 03:55:00,654 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, ActivateVdsVDSCommand, return: Host[host1], log id: 6cb51986 >2014-01-30 03:55:00,679 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] Activate finished. Lock released. Monitoring can run now for host host1 from data-center Default >2014-01-30 03:55:00,681 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] Lock freed to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 03:55:02,969 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) [4f6d8cf4] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:55:03,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64069324 >2014-01-30 03:55:04,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 64069324 >2014-01-30 03:55:04,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42c59e86 >2014-01-30 03:55:04,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ee0209c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83fcd22f}, log id: 42c59e86 >2014-01-30 03:55:07,993 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:55:08,431 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-15) [13272f75] No up server in cluster >2014-01-30 03:55:08,431 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-15) [13272f75] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:55:08,434 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-15) [13272f75] No up server in cluster >2014-01-30 03:55:08,434 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-15) [13272f75] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:55:08,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 59f10313 >2014-01-30 03:55:09,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 59f10313 >2014-01-30 03:55:09,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79c46e03 >2014-01-30 03:55:10,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 79c46e03 >2014-01-30 03:55:10,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b043299 >2014-01-30 03:55:10,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77e108d8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@514ce47f}, log id: 1b043299 >2014-01-30 03:55:13,017 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:55:15,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38af7b28 >2014-01-30 03:55:16,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 38af7b28 >2014-01-30 03:55:16,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5469aa56 >2014-01-30 03:55:16,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae4d63d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad6c367b}, log id: 5469aa56 >2014-01-30 03:55:18,039 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:55:21,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 70e2179d >2014-01-30 03:55:21,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 70e2179d >2014-01-30 03:55:21,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: cf31aa8 >2014-01-30 03:55:22,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d0436bc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3345b7a3}, log id: cf31aa8 >2014-01-30 03:55:23,061 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:55:27,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f5aca90 >2014-01-30 03:55:27,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4f5aca90 >2014-01-30 03:55:27,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7507ee3b >2014-01-30 03:55:28,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15cc52f8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b97c7d62}, log id: 7507ee3b >2014-01-30 03:55:28,078 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:55:33,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a0ef76 >2014-01-30 03:55:33,100 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:55:33,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3a0ef76 >2014-01-30 03:55:33,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 658c7160 >2014-01-30 03:55:33,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@167701d6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84d4ce27}, log id: 658c7160 >2014-01-30 03:55:38,118 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:55:38,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33673453 >2014-01-30 03:55:39,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 33673453 >2014-01-30 03:55:39,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2384a6ca >2014-01-30 03:55:39,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@864dc081, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@677bd6d8}, log id: 2384a6ca >2014-01-30 03:55:43,142 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:55:44,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 962fa5d >2014-01-30 03:55:45,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 962fa5d >2014-01-30 03:55:45,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f7da3f5 >2014-01-30 03:55:45,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e945e1d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0994aec}, log id: 2f7da3f5 >2014-01-30 03:55:48,167 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-53) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:55:50,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1074855d >2014-01-30 03:55:51,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1074855d >2014-01-30 03:55:51,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 480b0ac5 >2014-01-30 03:55:51,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e401511, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b69ff41c}, log id: 480b0ac5 >2014-01-30 03:55:53,188 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:55:56,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7bece0f0 >2014-01-30 03:55:56,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7bece0f0 >2014-01-30 03:55:56,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74da9f32 >2014-01-30 03:55:57,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c6b9492, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5d4bffd}, log id: 74da9f32 >2014-01-30 03:55:58,212 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:56:02,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40f9b974 >2014-01-30 03:56:02,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 40f9b974 >2014-01-30 03:56:02,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c693e41 >2014-01-30 03:56:02,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f928b87a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f511f00a}, log id: 2c693e41 >2014-01-30 03:56:03,251 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:56:08,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4840f8c7 >2014-01-30 03:56:08,269 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:56:08,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4840f8c7 >2014-01-30 03:56:08,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10f836e3 >2014-01-30 03:56:08,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89f8481c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f992a932}, log id: 10f836e3 >2014-01-30 03:56:09,231 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-47) [60a96c83] No up server in cluster >2014-01-30 03:56:09,231 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-47) [60a96c83] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:56:09,234 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-47) [60a96c83] No up server in cluster >2014-01-30 03:56:09,234 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-47) [60a96c83] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:56:09,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 246b327c >2014-01-30 03:56:10,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 246b327c >2014-01-30 03:56:13,289 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:56:13,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e8ee17 >2014-01-30 03:56:14,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: e8ee17 >2014-01-30 03:56:14,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d194f22 >2014-01-30 03:56:14,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a75af716, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6568ec92}, log id: 3d194f22 >2014-01-30 03:56:18,308 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:56:19,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48e4caea >2014-01-30 03:56:20,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 48e4caea >2014-01-30 03:56:20,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 410b2d04 >2014-01-30 03:56:20,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66ef5bfe, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@854bd315}, log id: 410b2d04 >2014-01-30 03:56:23,327 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:56:25,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13591268 >2014-01-30 03:56:26,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 13591268 >2014-01-30 03:56:26,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 61086b8b >2014-01-30 03:56:26,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdc317f6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5161e}, log id: 61086b8b >2014-01-30 03:56:28,348 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:56:31,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13ba6262 >2014-01-30 03:56:31,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 13ba6262 >2014-01-30 03:56:31,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7aed462c >2014-01-30 03:56:32,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e11a82, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61ccdc12}, log id: 7aed462c >2014-01-30 03:56:33,369 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:56:37,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 461861c7 >2014-01-30 03:56:37,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 461861c7 >2014-01-30 03:56:37,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 344103b1 >2014-01-30 03:56:37,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dca38e6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3521a13e}, log id: 344103b1 >2014-01-30 03:56:38,389 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:56:42,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 771b9d87 >2014-01-30 03:56:43,409 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:56:43,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 771b9d87 >2014-01-30 03:56:43,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5cb3f2af >2014-01-30 03:56:43,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a772e3b2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3007bc96}, log id: 5cb3f2af >2014-01-30 03:56:48,426 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:56:48,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a6c74e0 >2014-01-30 03:56:49,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1a6c74e0 >2014-01-30 03:56:49,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 135bea6a >2014-01-30 03:56:49,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62f6cfd3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d848ef1c}, log id: 135bea6a >2014-01-30 03:56:53,448 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:56:54,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 794174aa >2014-01-30 03:56:55,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 794174aa >2014-01-30 03:56:55,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: adbc56c >2014-01-30 03:56:55,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@429e12bb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e02f2aea}, log id: adbc56c >2014-01-30 03:56:58,468 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:57:00,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7bc5d082 >2014-01-30 03:57:00,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7bc5d082 >2014-01-30 03:57:00,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d346eb3 >2014-01-30 03:57:01,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fb29392, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3a8e5fd}, log id: 1d346eb3 >2014-01-30 03:57:03,491 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:57:06,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 745925a5 >2014-01-30 03:57:06,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 745925a5 >2014-01-30 03:57:06,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 289f17f0 >2014-01-30 03:57:07,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65ed8aa1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e5667a4}, log id: 289f17f0 >2014-01-30 03:57:08,508 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:57:10,067 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-71) [1ac2212e] No up server in cluster >2014-01-30 03:57:10,068 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-71) [1ac2212e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:57:10,071 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-71) [1ac2212e] No up server in cluster >2014-01-30 03:57:10,071 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-71) [1ac2212e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:57:10,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 8658f44 >2014-01-30 03:57:10,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 8658f44 >2014-01-30 03:57:12,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e4a332c >2014-01-30 03:57:12,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: e4a332c >2014-01-30 03:57:12,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 75b341c9 >2014-01-30 03:57:12,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a313d1c0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b20a2226}, log id: 75b341c9 >2014-01-30 03:57:13,531 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:57:17,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c92fbc >2014-01-30 03:57:18,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7c92fbc >2014-01-30 03:57:18,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53b96bb3 >2014-01-30 03:57:18,552 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:57:18,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a08cb366, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d34b96e3}, log id: 53b96bb3 >2014-01-30 03:57:23,573 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:57:23,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2227c608 >2014-01-30 03:57:24,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2227c608 >2014-01-30 03:57:24,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f0f8731 >2014-01-30 03:57:24,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5034d190, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e3a4058}, log id: 6f0f8731 >2014-01-30 03:57:28,594 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:57:29,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 772f3a1 >2014-01-30 03:57:29,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 772f3a1 >2014-01-30 03:57:30,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 218457f >2014-01-30 03:57:30,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2beab17d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@452ab31b}, log id: 218457f >2014-01-30 03:57:33,615 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:57:35,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 34ca422c >2014-01-30 03:57:35,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 34ca422c >2014-01-30 03:57:35,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 131cf63f >2014-01-30 03:57:36,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a720db0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4e10cf4}, log id: 131cf63f >2014-01-30 03:57:38,638 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:57:41,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4cf05733 >2014-01-30 03:57:41,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4cf05733 >2014-01-30 03:57:41,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4efc4bef >2014-01-30 03:57:41,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce524de5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1250555d}, log id: 4efc4bef >2014-01-30 03:57:43,659 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:57:46,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 229c20d0 >2014-01-30 03:57:47,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 229c20d0 >2014-01-30 03:57:47,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d3effdb >2014-01-30 03:57:47,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@372df015, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19f1e1e5}, log id: 6d3effdb >2014-01-30 03:57:48,678 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:57:52,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2691ad8 >2014-01-30 03:57:53,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2691ad8 >2014-01-30 03:57:53,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 461196b7 >2014-01-30 03:57:53,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4710d5b4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8cc94ae2}, log id: 461196b7 >2014-01-30 03:57:53,700 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:57:58,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e76d32c >2014-01-30 03:57:58,720 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:57:59,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3e76d32c >2014-01-30 03:57:59,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4424d7e0 >2014-01-30 03:57:59,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37dbef08, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@274472bc}, log id: 4424d7e0 >2014-01-30 03:58:03,743 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:58:04,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 795d0368 >2014-01-30 03:58:04,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 795d0368 >2014-01-30 03:58:04,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5851ad8e >2014-01-30 03:58:05,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c407e68c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2aea06f6}, log id: 5851ad8e >2014-01-30 03:58:08,765 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:58:10,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e49729b >2014-01-30 03:58:10,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: e49729b >2014-01-30 03:58:10,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4225a4cc >2014-01-30 03:58:10,893 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-96) [444c158d] No up server in cluster >2014-01-30 03:58:10,893 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-96) [444c158d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:58:10,896 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-96) [444c158d] No up server in cluster >2014-01-30 03:58:10,896 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-96) [444c158d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:58:10,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 654a22db >2014-01-30 03:58:11,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12dcdeb7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5a4fd20}, log id: 4225a4cc >2014-01-30 03:58:11,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 654a22db >2014-01-30 03:58:13,785 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:58:16,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c6026b0 >2014-01-30 03:58:16,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7c6026b0 >2014-01-30 03:58:16,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74a2a8aa >2014-01-30 03:58:16,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a9ca84b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5d3a55b}, log id: 74a2a8aa >2014-01-30 03:58:18,805 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:58:21,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26e5ff3a >2014-01-30 03:58:22,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 26e5ff3a >2014-01-30 03:58:22,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a10b4b8 >2014-01-30 03:58:22,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa159622, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1532303}, log id: 6a10b4b8 >2014-01-30 03:58:23,827 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:58:27,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23fccc63 >2014-01-30 03:58:28,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 23fccc63 >2014-01-30 03:58:28,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 785215ce >2014-01-30 03:58:28,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e0f224b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5dffaa}, log id: 785215ce >2014-01-30 03:58:28,850 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:58:33,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78a7f399 >2014-01-30 03:58:33,868 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:58:33,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 78a7f399 >2014-01-30 03:58:34,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42051cae >2014-01-30 03:58:34,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8626cbf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4183cd6e}, log id: 42051cae >2014-01-30 03:58:38,885 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:58:39,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56b6e157 >2014-01-30 03:58:39,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 56b6e157 >2014-01-30 03:58:39,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d642995 >2014-01-30 03:58:40,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69b0793, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d68ccc9a}, log id: 7d642995 >2014-01-30 03:58:43,905 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:58:45,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c7085e7 >2014-01-30 03:58:45,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1c7085e7 >2014-01-30 03:58:45,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 604c795a >2014-01-30 03:58:45,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@658c3878, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@162a7493}, log id: 604c795a >2014-01-30 03:58:48,926 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:58:50,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: cd90f1f >2014-01-30 03:58:51,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: cd90f1f >2014-01-30 03:58:51,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 721411b1 >2014-01-30 03:58:51,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28ae4967, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@799db083}, log id: 721411b1 >2014-01-30 03:58:53,949 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:58:56,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3634c87c >2014-01-30 03:58:57,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3634c87c >2014-01-30 03:58:57,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 70a0ffb0 >2014-01-30 03:58:57,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64215265, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d100b7ff}, log id: 70a0ffb0 >2014-01-30 03:58:58,970 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:59:02,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ef51675 >2014-01-30 03:59:03,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4ef51675 >2014-01-30 03:59:03,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 258bc4e7 >2014-01-30 03:59:03,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72023d89, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c23ddbb6}, log id: 258bc4e7 >2014-01-30 03:59:03,990 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:59:08,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2bf5830 >2014-01-30 03:59:08,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2bf5830 >2014-01-30 03:59:08,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ad7fb06 >2014-01-30 03:59:09,010 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:59:09,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79f1a023, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2943fb4b}, log id: 6ad7fb06 >2014-01-30 03:59:11,702 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-86) [7893a550] No up server in cluster >2014-01-30 03:59:11,702 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-86) [7893a550] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:59:11,705 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-86) [7893a550] No up server in cluster >2014-01-30 03:59:11,705 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-86) [7893a550] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 03:59:11,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77f5771d >2014-01-30 03:59:12,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 77f5771d >2014-01-30 03:59:14,029 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:59:14,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b00be3a >2014-01-30 03:59:14,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4b00be3a >2014-01-30 03:59:14,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2df59544 >2014-01-30 03:59:15,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7700d02, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69a68526}, log id: 2df59544 >2014-01-30 03:59:19,051 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:59:20,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e0ec4a4 >2014-01-30 03:59:20,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4e0ec4a4 >2014-01-30 03:59:20,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72648643 >2014-01-30 03:59:20,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4715f012] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ea3da0f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11ca48c1}, log id: 72648643 >2014-01-30 03:59:24,073 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:59:25,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71fdca56 >2014-01-30 03:59:26,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 71fdca56 >2014-01-30 03:59:26,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42cc16d8 >2014-01-30 03:59:26,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8363a418, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@150eaa4c}, log id: 42cc16d8 >2014-01-30 03:59:29,094 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:59:31,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74acd6d4 >2014-01-30 03:59:32,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 74acd6d4 >2014-01-30 03:59:32,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23f49210 >2014-01-30 03:59:32,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62ecd727, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8134a04c}, log id: 23f49210 >2014-01-30 03:59:34,116 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:59:37,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1046d84e >2014-01-30 03:59:38,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1046d84e >2014-01-30 03:59:38,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 714bb74a >2014-01-30 03:59:38,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96688592, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e93e4fd2}, log id: 714bb74a >2014-01-30 03:59:39,138 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) [4f6d8cf4] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:59:43,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 793d3c86 >2014-01-30 03:59:43,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 793d3c86 >2014-01-30 03:59:43,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8e751be >2014-01-30 03:59:44,044 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-62) [1449451c] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 03:59:44,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@465996ed, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43f5be6e}, log id: 8e751be >2014-01-30 03:59:44,159 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:59:44,169 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-62) [1449451c] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 03:59:44,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6425a7bf >2014-01-30 03:59:44,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7672e067, log id: 6425a7bf >2014-01-30 03:59:44,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6feac6f1 >2014-01-30 03:59:44,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@5c464369, log id: 6feac6f1 >2014-01-30 03:59:49,179 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:59:49,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c8ea04c >2014-01-30 03:59:49,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: c8ea04c >2014-01-30 03:59:49,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b79ad2d >2014-01-30 03:59:50,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73684bdf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c072513f}, log id: 2b79ad2d >2014-01-30 03:59:54,203 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 03:59:55,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b3c8f10 >2014-01-30 03:59:55,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3b3c8f10 >2014-01-30 03:59:55,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4fb8c8e4 >2014-01-30 03:59:55,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec975650, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a909cb14}, log id: 4fb8c8e4 >2014-01-30 03:59:59,224 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-39) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:00:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-31) [4715f012] Autorecovering 1 hosts >2014-01-30 04:00:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-31) [4715f012] Autorecovering hosts id: 80dfb2ba-85ca-41d0-9af5-8468c89e2354, name : host1 >2014-01-30 04:00:00,012 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-31) [5a6a1355] Lock Acquired to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 04:00:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-31) [5a6a1355] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 04:00:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-31) [5a6a1355] Before acquiring lock in order to prevent monitoring for host host1 from data-center Default >2014-01-30 04:00:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-31) [5a6a1355] Lock acquired, from now a monitoring of host will be skipped for host host1 from data-center Default >2014-01-30 04:00:00,023 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-31) [5a6a1355] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=Unassigned, nonOperationalReason=NONE), log id: 47881aa0 >2014-01-30 04:00:00,027 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-31) [5a6a1355] FINISH, SetVdsStatusVDSCommand, log id: 47881aa0 >2014-01-30 04:00:00,030 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-31) [5a6a1355] START, ActivateVdsVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 55b6b3aa >2014-01-30 04:00:00,627 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-31) [5a6a1355] START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, vds=Host[host1]), log id: 45b8aea0 >2014-01-30 04:00:00,657 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-31) [5a6a1355] FINISH, GetHardwareInfoVDSCommand, log id: 45b8aea0 >2014-01-30 04:00:00,686 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-31) [1f64626f] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 04:00:00,688 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-31) [1f64626f] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=NonOperational, nonOperationalReason=NETWORK_UNREACHABLE), log id: 336c80b5 >2014-01-30 04:00:00,693 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-31) [1f64626f] FINISH, SetVdsStatusVDSCommand, log id: 336c80b5 >2014-01-30 04:00:00,699 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-31) [1f64626f] Host host1 is set to Non-Operational, it is missing the following networks: ovirtmgmt >2014-01-30 04:00:00,705 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-31) [1f64626f] Correlation ID: 1f64626f, Job ID: 1c96debe-e7fd-416d-bb01-37f55187c89d, Call Stack: null, Custom Event ID: -1, Message: Host host1 does not comply with the cluster test_1 networks, the following networks are missing on host: 'ovirtmgmt' >2014-01-30 04:00:00,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [1f64626f] START, GlusterServersListVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 4441097a >2014-01-30 04:00:00,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23e6e30 >2014-01-30 04:00:01,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [1f64626f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.220:CONNECTED, 10.70.37.158:CONNECTED], log id: 4441097a >2014-01-30 04:00:01,151 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 04:00:01,152 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, ActivateVdsVDSCommand, return: Host[host1], log id: 55b6b3aa >2014-01-30 04:00:01,169 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Activate finished. Lock released. Monitoring can run now for host host1 from data-center Default >2014-01-30 04:00:01,171 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Lock freed to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 04:00:01,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 23e6e30 >2014-01-30 04:00:01,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 403f3384 >2014-01-30 04:00:01,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8a36a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c97524c}, log id: 403f3384 >2014-01-30 04:00:04,250 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:00:06,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b07b354 >2014-01-30 04:00:07,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: b07b354 >2014-01-30 04:00:07,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52c57f42 >2014-01-30 04:00:07,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f4e7ff7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd9f03c9}, log id: 52c57f42 >2014-01-30 04:00:09,273 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:00:12,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59656c20 >2014-01-30 04:00:12,551 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] No up server in cluster >2014-01-30 04:00:12,551 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:00:12,554 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] No up server in cluster >2014-01-30 04:00:12,554 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:00:12,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a564683 >2014-01-30 04:00:12,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 59656c20 >2014-01-30 04:00:12,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15e1639c >2014-01-30 04:00:13,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c8c0de6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@300440d5}, log id: 15e1639c >2014-01-30 04:00:13,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 3a564683 >2014-01-30 04:00:14,292 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:00:18,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b79bfa7 >2014-01-30 04:00:18,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1b79bfa7 >2014-01-30 04:00:18,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b62d6d0 >2014-01-30 04:00:18,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4e6ed75, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6223b71e}, log id: 3b62d6d0 >2014-01-30 04:00:19,314 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:00:23,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7338b45d >2014-01-30 04:00:24,334 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:00:24,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7338b45d >2014-01-30 04:00:24,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f1c2b1d >2014-01-30 04:00:24,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e0c2d4b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc856064}, log id: 3f1c2b1d >2014-01-30 04:00:29,354 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:00:29,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3dfde62 >2014-01-30 04:00:30,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3dfde62 >2014-01-30 04:00:30,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18d3af96 >2014-01-30 04:00:30,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af471e7e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73f386f1}, log id: 18d3af96 >2014-01-30 04:00:34,375 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:00:35,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17ef6e4c >2014-01-30 04:00:36,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 17ef6e4c >2014-01-30 04:00:36,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26f026ea >2014-01-30 04:00:36,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c0c39b6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49d526c9}, log id: 26f026ea >2014-01-30 04:00:39,398 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:00:41,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78eeae8c >2014-01-30 04:00:41,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 78eeae8c >2014-01-30 04:00:41,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f561083 >2014-01-30 04:00:42,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93bcf5e5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc329fe8}, log id: 4f561083 >2014-01-30 04:00:44,420 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:00:47,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ab2292b >2014-01-30 04:00:47,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7ab2292b >2014-01-30 04:00:47,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3716333b >2014-01-30 04:00:48,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54f719c6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd945622}, log id: 3716333b >2014-01-30 04:00:49,440 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:00:53,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b50939f >2014-01-30 04:00:53,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6b50939f >2014-01-30 04:00:53,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48e3d7fe >2014-01-30 04:00:53,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9bce6e0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@978b73b}, log id: 48e3d7fe >2014-01-30 04:00:54,463 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:00:58,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a4b4d0e >2014-01-30 04:00:59,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a4b4d0e >2014-01-30 04:00:59,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49e94b28 >2014-01-30 04:00:59,483 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-4) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:00:59,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93a9a842, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e178a20e}, log id: 49e94b28 >2014-01-30 04:01:04,503 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:01:04,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21daeefb >2014-01-30 04:01:05,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 21daeefb >2014-01-30 04:01:05,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: efe14f6 >2014-01-30 04:01:05,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c51ea02, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96738cff}, log id: efe14f6 >2014-01-30 04:01:09,526 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:01:10,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c008321 >2014-01-30 04:01:11,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c008321 >2014-01-30 04:01:11,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e8e1c42 >2014-01-30 04:01:11,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@baadefed, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5292f1f}, log id: 7e8e1c42 >2014-01-30 04:01:13,327 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) [b80ce35] No up server in cluster >2014-01-30 04:01:13,327 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) [b80ce35] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:01:13,330 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) [b80ce35] No up server in cluster >2014-01-30 04:01:13,330 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) [b80ce35] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:01:13,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 286a147e >2014-01-30 04:01:14,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 286a147e >2014-01-30 04:01:14,546 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:01:16,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 243205c0 >2014-01-30 04:01:16,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 243205c0 >2014-01-30 04:01:16,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37080f01 >2014-01-30 04:01:17,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49326b14, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3406f7d6}, log id: 37080f01 >2014-01-30 04:01:19,566 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:01:22,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2aadba21 >2014-01-30 04:01:22,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2aadba21 >2014-01-30 04:01:22,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a7f0d4d >2014-01-30 04:01:23,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e991a445, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1d1ae71}, log id: a7f0d4d >2014-01-30 04:01:24,589 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:01:28,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4704853e >2014-01-30 04:01:28,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4704853e >2014-01-30 04:01:28,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d257fd9 >2014-01-30 04:01:28,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8bdafe3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc5ec5f6}, log id: 3d257fd9 >2014-01-30 04:01:29,610 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:01:33,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72c77974 >2014-01-30 04:01:34,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 72c77974 >2014-01-30 04:01:34,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66e93e17 >2014-01-30 04:01:34,629 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:01:34,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21557c6a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce07782b}, log id: 66e93e17 >2014-01-30 04:01:39,650 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:01:39,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 562d79c8 >2014-01-30 04:01:40,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 562d79c8 >2014-01-30 04:01:40,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59788d91 >2014-01-30 04:01:40,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d02e97de, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@175d167}, log id: 59788d91 >2014-01-30 04:01:44,672 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:01:45,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59c53553 >2014-01-30 04:01:46,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 59c53553 >2014-01-30 04:01:46,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d886dab >2014-01-30 04:01:46,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1492e4d4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52876d2d}, log id: 2d886dab >2014-01-30 04:01:49,694 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:01:51,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5809d8d7 >2014-01-30 04:01:51,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5809d8d7 >2014-01-30 04:01:51,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b026a7f >2014-01-30 04:01:52,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@348187ad, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77ced888}, log id: b026a7f >2014-01-30 04:01:54,715 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:01:57,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 70e4e128 >2014-01-30 04:01:57,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 70e4e128 >2014-01-30 04:01:57,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4be1e7ac >2014-01-30 04:01:57,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9e0e9ca, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1851415c}, log id: 4be1e7ac >2014-01-30 04:01:59,730 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:02:02,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50d8a1dc >2014-01-30 04:02:03,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 50d8a1dc >2014-01-30 04:02:03,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52da2a9a >2014-01-30 04:02:03,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd7ea470, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d273da06}, log id: 52da2a9a >2014-01-30 04:02:04,768 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:02:08,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d42c549 >2014-01-30 04:02:09,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1d42c549 >2014-01-30 04:02:09,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b7805b9 >2014-01-30 04:02:09,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce4d95f4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e9e6b62}, log id: 5b7805b9 >2014-01-30 04:02:09,789 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:02:14,177 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-50) No up server in cluster >2014-01-30 04:02:14,177 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-50) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:02:14,180 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-50) No up server in cluster >2014-01-30 04:02:14,180 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-50) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:02:14,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 415f2eda >2014-01-30 04:02:14,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f01181c >2014-01-30 04:02:14,809 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:02:14,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 415f2eda >2014-01-30 04:02:15,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1f01181c >2014-01-30 04:02:15,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f399aa0 >2014-01-30 04:02:15,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33644e52, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b549a80}, log id: 3f399aa0 >2014-01-30 04:02:19,828 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-4) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:02:20,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f8c2e0d >2014-01-30 04:02:20,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1f8c2e0d >2014-01-30 04:02:20,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 207bbfe4 >2014-01-30 04:02:21,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e00321d8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@204f827d}, log id: 207bbfe4 >2014-01-30 04:02:24,848 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:02:26,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 162f0807 >2014-01-30 04:02:26,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 162f0807 >2014-01-30 04:02:26,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 101fea0c >2014-01-30 04:02:27,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [622832bf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d3eeb96, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d49a624b}, log id: 101fea0c >2014-01-30 04:02:29,869 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:02:32,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60d2d238 >2014-01-30 04:02:32,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 60d2d238 >2014-01-30 04:02:32,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 57c3eb06 >2014-01-30 04:02:32,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a0eeb6c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb290d43}, log id: 57c3eb06 >2014-01-30 04:02:34,888 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:02:37,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ee9a690 >2014-01-30 04:02:38,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5ee9a690 >2014-01-30 04:02:38,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 684166fa >2014-01-30 04:02:38,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44378e74, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c241300f}, log id: 684166fa >2014-01-30 04:02:39,908 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:02:43,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e1612f0 >2014-01-30 04:02:44,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6e1612f0 >2014-01-30 04:02:44,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ab0dd5e >2014-01-30 04:02:44,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b48a061, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dac3cbae}, log id: 7ab0dd5e >2014-01-30 04:02:44,927 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:02:49,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 625764fc >2014-01-30 04:02:49,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 625764fc >2014-01-30 04:02:49,950 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:02:49,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37b5e697 >2014-01-30 04:02:50,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfb1e714, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c22a27}, log id: 37b5e697 >2014-01-30 04:02:54,971 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:02:55,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e81f09a >2014-01-30 04:02:55,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1e81f09a >2014-01-30 04:02:55,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ac1072 >2014-01-30 04:02:56,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a312b717, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aecee138}, log id: ac1072 >2014-01-30 04:02:59,992 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:03:01,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1de5481f >2014-01-30 04:03:01,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1de5481f >2014-01-30 04:03:01,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7696a78c >2014-01-30 04:03:01,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb8cc10b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36d5051f}, log id: 7696a78c >2014-01-30 04:03:05,019 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:03:06,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25fcae44 >2014-01-30 04:03:07,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 25fcae44 >2014-01-30 04:03:07,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8d838f4 >2014-01-30 04:03:07,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e845683f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@320ed5a5}, log id: 8d838f4 >2014-01-30 04:03:10,041 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:03:12,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6cc26376 >2014-01-30 04:03:13,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6cc26376 >2014-01-30 04:03:13,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f6a41b9 >2014-01-30 04:03:13,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@403be56c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43cab872}, log id: 1f6a41b9 >2014-01-30 04:03:14,978 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) [23554188] No up server in cluster >2014-01-30 04:03:14,978 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) [23554188] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:03:14,982 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) [23554188] No up server in cluster >2014-01-30 04:03:14,982 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) [23554188] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:03:14,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 28a07bcd >2014-01-30 04:03:15,062 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:03:15,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 28a07bcd >2014-01-30 04:03:18,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b73b200 >2014-01-30 04:03:19,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6b73b200 >2014-01-30 04:03:19,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 648d2992 >2014-01-30 04:03:19,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69338afe, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@476d871f}, log id: 648d2992 >2014-01-30 04:03:20,080 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:03:24,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3efbf1cc >2014-01-30 04:03:24,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3efbf1cc >2014-01-30 04:03:24,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50d07a80 >2014-01-30 04:03:25,104 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:03:25,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a59b4a1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83b777fc}, log id: 50d07a80 >2014-01-30 04:03:30,125 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:03:30,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 445d5c7 >2014-01-30 04:03:30,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 445d5c7 >2014-01-30 04:03:30,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77ea72c7 >2014-01-30 04:03:30,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f5eab7a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba24dfb}, log id: 77ea72c7 >2014-01-30 04:03:35,146 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:03:36,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 361f7441 >2014-01-30 04:03:36,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 361f7441 >2014-01-30 04:03:36,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c6b71a0 >2014-01-30 04:03:36,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2039361, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5ffa77d}, log id: 7c6b71a0 >2014-01-30 04:03:40,166 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:03:41,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 416116f >2014-01-30 04:03:42,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 416116f >2014-01-30 04:03:42,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64eac904 >2014-01-30 04:03:42,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55b7bc0a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2db8b9db}, log id: 64eac904 >2014-01-30 04:03:45,189 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:03:47,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53e7fd32 >2014-01-30 04:03:48,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 53e7fd32 >2014-01-30 04:03:48,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2038eb2e >2014-01-30 04:03:48,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3c8ec1d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2616c662}, log id: 2038eb2e >2014-01-30 04:03:50,208 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:03:53,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12531758 >2014-01-30 04:03:54,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 12531758 >2014-01-30 04:03:54,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 323c409d >2014-01-30 04:03:54,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9872ca3c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98fccf}, log id: 323c409d >2014-01-30 04:03:55,227 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:03:59,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7267e4f5 >2014-01-30 04:03:59,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7267e4f5 >2014-01-30 04:03:59,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f8fd6c3 >2014-01-30 04:04:00,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b613b54, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b210381a}, log id: 6f8fd6c3 >2014-01-30 04:04:00,246 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:04:05,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71bf65f3 >2014-01-30 04:04:05,265 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:04:05,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 71bf65f3 >2014-01-30 04:04:05,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53186763 >2014-01-30 04:04:05,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fa5d283, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88fb7642}, log id: 53186763 >2014-01-30 04:04:10,282 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:04:10,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 696c2e0f >2014-01-30 04:04:11,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 696c2e0f >2014-01-30 04:04:11,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71dfcf8f >2014-01-30 04:04:11,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6eec23e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6aae465b}, log id: 71dfcf8f >2014-01-30 04:04:15,303 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:04:15,798 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-87) [6fd19374] No up server in cluster >2014-01-30 04:04:15,798 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-87) [6fd19374] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:04:15,801 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-87) [6fd19374] No up server in cluster >2014-01-30 04:04:15,801 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-87) [6fd19374] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:04:15,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 1adf9a00 >2014-01-30 04:04:16,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 1adf9a00 >2014-01-30 04:04:16,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e8e9345 >2014-01-30 04:04:17,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4e8e9345 >2014-01-30 04:04:17,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b6606e4 >2014-01-30 04:04:17,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11ff0a6a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d548bbeb}, log id: 7b6606e4 >2014-01-30 04:04:20,325 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:04:22,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b0ad8a3 >2014-01-30 04:04:23,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2b0ad8a3 >2014-01-30 04:04:23,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b6599ca >2014-01-30 04:04:23,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16ef8f0b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8114ed41}, log id: 6b6599ca >2014-01-30 04:04:25,346 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:04:28,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b27ddeb >2014-01-30 04:04:28,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1b27ddeb >2014-01-30 04:04:28,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22160bdf >2014-01-30 04:04:29,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85e5b1fc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35733edc}, log id: 22160bdf >2014-01-30 04:04:30,368 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:04:34,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43bba432 >2014-01-30 04:04:34,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43bba432 >2014-01-30 04:04:34,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 191664da >2014-01-30 04:04:35,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89d031bb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46f95ef9}, log id: 191664da >2014-01-30 04:04:35,392 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:04:40,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f90b3d4 >2014-01-30 04:04:40,411 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:04:40,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1f90b3d4 >2014-01-30 04:04:40,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 566c551c >2014-01-30 04:04:40,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9524e7e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd21e54}, log id: 566c551c >2014-01-30 04:04:44,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: f677b14 >2014-01-30 04:04:45,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@5e54e2cc, log id: f677b14 >2014-01-30 04:04:45,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 16f5ef76 >2014-01-30 04:04:45,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2428714, log id: 16f5ef76 >2014-01-30 04:04:45,430 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:04:45,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 942e371 >2014-01-30 04:04:46,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 942e371 >2014-01-30 04:04:46,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a00c0e >2014-01-30 04:04:46,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3867a92, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fec156df}, log id: a00c0e >2014-01-30 04:04:50,448 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:04:51,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 485c58ae >2014-01-30 04:04:52,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 485c58ae >2014-01-30 04:04:52,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c5453d3 >2014-01-30 04:04:52,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cd9a6cf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6367fec0}, log id: 1c5453d3 >2014-01-30 04:04:55,469 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:04:57,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3402e4a9 >2014-01-30 04:04:58,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3402e4a9 >2014-01-30 04:04:58,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7dcfa0a7 >2014-01-30 04:04:58,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c9c50aa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef801d17}, log id: 7dcfa0a7 >2014-01-30 04:05:00,007 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-83) [622832bf] Autorecovering 1 hosts >2014-01-30 04:05:00,008 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-83) [622832bf] Autorecovering hosts id: 80dfb2ba-85ca-41d0-9af5-8468c89e2354, name : host1 >2014-01-30 04:05:00,011 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-83) [4531e579] Lock Acquired to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 04:05:00,011 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-83) [4531e579] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 04:05:00,011 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-83) [4531e579] Before acquiring lock in order to prevent monitoring for host host1 from data-center Default >2014-01-30 04:05:00,011 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-83) [4531e579] Lock acquired, from now a monitoring of host will be skipped for host host1 from data-center Default >2014-01-30 04:05:00,020 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-83) [4531e579] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=Unassigned, nonOperationalReason=NONE), log id: 463dab27 >2014-01-30 04:05:00,025 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-83) [4531e579] FINISH, SetVdsStatusVDSCommand, log id: 463dab27 >2014-01-30 04:05:00,029 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-83) [4531e579] START, ActivateVdsVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: b768655 >2014-01-30 04:05:00,094 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-83) [4531e579] START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, vds=Host[host1]), log id: 2d59fee >2014-01-30 04:05:00,107 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-83) [4531e579] FINISH, GetHardwareInfoVDSCommand, log id: 2d59fee >2014-01-30 04:05:00,144 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-83) [5c18a2d1] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 04:05:00,147 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-83) [5c18a2d1] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=NonOperational, nonOperationalReason=NETWORK_UNREACHABLE), log id: 6fce7d4d >2014-01-30 04:05:00,152 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-83) [5c18a2d1] FINISH, SetVdsStatusVDSCommand, log id: 6fce7d4d >2014-01-30 04:05:00,158 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-83) [5c18a2d1] Host host1 is set to Non-Operational, it is missing the following networks: ovirtmgmt >2014-01-30 04:05:00,169 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-83) [5c18a2d1] Correlation ID: 5c18a2d1, Job ID: f3687843-d53e-4b0d-987b-1b80798211ec, Call Stack: null, Custom Event ID: -1, Message: Host host1 does not comply with the cluster test_1 networks, the following networks are missing on host: 'ovirtmgmt' >2014-01-30 04:05:00,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [5c18a2d1] START, GlusterServersListVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 53bdcd88 >2014-01-30 04:05:00,489 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:05:00,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [5c18a2d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.220:CONNECTED, 10.70.37.158:CONNECTED], log id: 53bdcd88 >2014-01-30 04:05:00,684 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 04:05:00,685 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, ActivateVdsVDSCommand, return: Host[host1], log id: b768655 >2014-01-30 04:05:00,705 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] Activate finished. Lock released. Monitoring can run now for host host1 from data-center Default >2014-01-30 04:05:00,707 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] Lock freed to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 04:05:03,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 381664fe >2014-01-30 04:05:03,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 381664fe >2014-01-30 04:05:03,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 145f56f3 >2014-01-30 04:05:04,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d63ba14f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9b984d0}, log id: 145f56f3 >2014-01-30 04:05:05,513 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:05:09,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ebe61dd >2014-01-30 04:05:09,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1ebe61dd >2014-01-30 04:05:09,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49ccb325 >2014-01-30 04:05:09,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b3d255, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e9aced4}, log id: 49ccb325 >2014-01-30 04:05:10,535 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:05:15,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 34cec476 >2014-01-30 04:05:15,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 34cec476 >2014-01-30 04:05:15,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ccb6c6f >2014-01-30 04:05:15,557 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:05:15,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0555baf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbaaf8cb}, log id: 2ccb6c6f >2014-01-30 04:05:16,622 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-92) [61402a04] No up server in cluster >2014-01-30 04:05:16,623 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-92) [61402a04] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:05:16,626 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-92) [61402a04] No up server in cluster >2014-01-30 04:05:16,626 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-92) [61402a04] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:05:16,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 101ccb44 >2014-01-30 04:05:17,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[a980a28b-7542-43e3-b3a5-54918ecf09aa-REMOVE_BRICK-FINISHED], GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 101ccb44 >2014-01-30 04:05:20,579 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:05:20,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2981f33d >2014-01-30 04:05:21,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2981f33d >2014-01-30 04:05:21,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b1399e5 >2014-01-30 04:05:21,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@649e213a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf620816}, log id: 3b1399e5 >2014-01-30 04:05:25,600 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:05:26,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e96cb6f >2014-01-30 04:05:27,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: e96cb6f >2014-01-30 04:05:27,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7efcb65d >2014-01-30 04:05:27,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d4ae282, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b13ca455}, log id: 7efcb65d >2014-01-30 04:05:30,622 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:05:32,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a3778a8 >2014-01-30 04:05:32,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2a3778a8 >2014-01-30 04:05:32,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 145b97e4 >2014-01-30 04:05:33,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a06c4d69, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6434cda}, log id: 145b97e4 >2014-01-30 04:05:35,640 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:05:38,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6626ee86 >2014-01-30 04:05:38,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6626ee86 >2014-01-30 04:05:38,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e42e4d3 >2014-01-30 04:05:39,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e80eda0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea445531}, log id: 3e42e4d3 >2014-01-30 04:05:40,661 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:05:44,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38a91855 >2014-01-30 04:05:44,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 38a91855 >2014-01-30 04:05:44,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3253acf0 >2014-01-30 04:05:44,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@139091dd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efacb742}, log id: 3253acf0 >2014-01-30 04:05:45,684 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-68) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:05:49,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7213ced1 >2014-01-30 04:05:50,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7213ced1 >2014-01-30 04:05:50,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71b78635 >2014-01-30 04:05:50,703 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:05:50,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a759c618, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24382e12}, log id: 71b78635 >2014-01-30 04:05:55,724 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:05:55,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 750bf5b6 >2014-01-30 04:05:56,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 750bf5b6 >2014-01-30 04:05:56,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69e267e1 >2014-01-30 04:05:56,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8b72d47, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31bfc979}, log id: 69e267e1 >2014-01-30 04:06:00,747 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:06:01,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18768b43 >2014-01-30 04:06:02,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 18768b43 >2014-01-30 04:06:02,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2768d7f8 >2014-01-30 04:06:02,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd4eba74, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6faec78c}, log id: 2768d7f8 >2014-01-30 04:06:04,806 INFO [org.ovirt.engine.core.bll.gluster.StopRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-2) [5d1a45c1] Running command: StopRemoveGlusterVolumeBricksCommand internal: false. Entities affected : ID: 1f4efadb-6593-4316-81a5-a21ecebcf4ad Type: GlusterVolume >2014-01-30 04:06:04,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.StopRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-2) [5d1a45c1] START, StopRemoveGlusterVolumeBricksVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5605fd14 >2014-01-30 04:06:05,768 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:06:07,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23f383d5 >2014-01-30 04:06:07,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.StopRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-2) [5d1a45c1] FINISH, StopRemoveGlusterVolumeBricksVDSCommand, log id: 5605fd14 >2014-01-30 04:06:07,673 INFO [org.ovirt.engine.core.bll.gluster.StopRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-2) [5d1a45c1] Lock freed to object EngineLock [exclusiveLocks= key: 1f4efadb-6593-4316-81a5-a21ecebcf4ad value: GLUSTER >, sharedLocks= ] >2014-01-30 04:06:07,676 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-2) [5d1a45c1] Correlation ID: 5d1a45c1, Call Stack: null, Custom Event ID: -1, Message: Stopped removing bricks from Volume dis_vol >2014-01-30 04:06:07,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-7) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 329faf3e >2014-01-30 04:06:07,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 23f383d5 >2014-01-30 04:06:07,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22876ef3 >2014-01-30 04:06:08,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-7) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@70ea688e, log id: 329faf3e >2014-01-30 04:06:08,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d09aa60f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b20e7a7c}, log id: 22876ef3 >2014-01-30 04:06:10,796 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-50) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:06:13,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b2df6ca >2014-01-30 04:06:13,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2b2df6ca >2014-01-30 04:06:13,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e662176 >2014-01-30 04:06:13,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80a51d69, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43dc2607}, log id: 6e662176 >2014-01-30 04:06:15,816 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:06:17,440 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-91) [51ec2212] No up server in cluster >2014-01-30 04:06:17,440 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-91) [51ec2212] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:06:17,443 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-91) [51ec2212] No up server in cluster >2014-01-30 04:06:17,443 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-91) [51ec2212] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:06:17,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 67b472b5 >2014-01-30 04:06:17,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 67b472b5 >2014-01-30 04:06:19,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1206aeec >2014-01-30 04:06:19,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1206aeec >2014-01-30 04:06:19,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 612faebf >2014-01-30 04:06:19,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f83b4234, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33f40848}, log id: 612faebf >2014-01-30 04:06:20,836 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:06:24,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 399a05bf >2014-01-30 04:06:25,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 399a05bf >2014-01-30 04:06:25,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46699988 >2014-01-30 04:06:25,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28ba91b9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7342217b}, log id: 46699988 >2014-01-30 04:06:25,857 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:06:30,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fb43741 >2014-01-30 04:06:30,877 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:06:31,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3fb43741 >2014-01-30 04:06:31,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b3ce47e >2014-01-30 04:06:31,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcefe03e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e219a96}, log id: 2b3ce47e >2014-01-30 04:06:35,898 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:06:36,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14a27b48 >2014-01-30 04:06:36,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 14a27b48 >2014-01-30 04:06:36,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 791b9cfa >2014-01-30 04:06:37,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdd57ff5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d562bf1}, log id: 791b9cfa >2014-01-30 04:06:40,921 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:06:42,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 200f9d31 >2014-01-30 04:06:42,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 200f9d31 >2014-01-30 04:06:42,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16f04285 >2014-01-30 04:06:43,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bec6cabf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35037e8d}, log id: 16f04285 >2014-01-30 04:06:45,943 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:06:48,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e662707 >2014-01-30 04:06:48,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e662707 >2014-01-30 04:06:48,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c349815 >2014-01-30 04:06:48,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b9216d0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e97cff89}, log id: 3c349815 >2014-01-30 04:06:50,961 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-50) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:06:53,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f525573 >2014-01-30 04:06:54,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4f525573 >2014-01-30 04:06:54,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c5ae628 >2014-01-30 04:06:54,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4be74bb2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef0f961c}, log id: 5c5ae628 >2014-01-30 04:06:55,981 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-4) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:06:59,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3cfce7f4 >2014-01-30 04:07:00,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3cfce7f4 >2014-01-30 04:07:00,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 630a5a1 >2014-01-30 04:07:00,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe87161c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a4fe6eb}, log id: 630a5a1 >2014-01-30 04:07:01,002 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:07:05,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 171666c6 >2014-01-30 04:07:06,031 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:07:06,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 171666c6 >2014-01-30 04:07:06,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b260407 >2014-01-30 04:07:06,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60604c35, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bac741}, log id: 6b260407 >2014-01-30 04:07:11,055 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:07:11,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 98a6d20 >2014-01-30 04:07:11,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 98a6d20 >2014-01-30 04:07:11,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7dbde539 >2014-01-30 04:07:12,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d694d95b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7beb54db}, log id: 7dbde539 >2014-01-30 04:07:16,077 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:07:17,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72cedb5 >2014-01-30 04:07:17,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 72cedb5 >2014-01-30 04:07:17,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 494ef051 >2014-01-30 04:07:18,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3b301bc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7665c7ae}, log id: 494ef051 >2014-01-30 04:07:18,009 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-65) [227486be] No up server in cluster >2014-01-30 04:07:18,009 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-65) [227486be] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:07:18,013 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-65) [227486be] No up server in cluster >2014-01-30 04:07:18,013 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-65) [227486be] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:07:18,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 79efce1d >2014-01-30 04:07:18,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 79efce1d >2014-01-30 04:07:21,097 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:07:23,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 61368aee >2014-01-30 04:07:23,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 61368aee >2014-01-30 04:07:23,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c0e1210 >2014-01-30 04:07:23,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4822a51f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9a1bfe1}, log id: 6c0e1210 >2014-01-30 04:07:26,122 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:07:28,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7879d829 >2014-01-30 04:07:29,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7879d829 >2014-01-30 04:07:29,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 73e32573 >2014-01-30 04:07:29,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd9ea651, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45719548}, log id: 73e32573 >2014-01-30 04:07:31,144 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:07:34,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e9f9bf1 >2014-01-30 04:07:35,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6e9f9bf1 >2014-01-30 04:07:35,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20da5886 >2014-01-30 04:07:35,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccc69b9e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e04ed894}, log id: 20da5886 >2014-01-30 04:07:36,166 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:07:40,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 559fbdcc >2014-01-30 04:07:40,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 559fbdcc >2014-01-30 04:07:40,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10f6a101 >2014-01-30 04:07:41,190 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:07:41,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef4ca8ee, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b826ab3b}, log id: 10f6a101 >2014-01-30 04:07:46,209 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:07:46,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76b3204b >2014-01-30 04:07:46,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 76b3204b >2014-01-30 04:07:46,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7fda752 >2014-01-30 04:07:46,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1392c2f2 >2014-01-30 04:07:47,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@149c0be3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91732d93}, log id: 7fda752 >2014-01-30 04:07:47,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-2) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@37db6f32, log id: 1392c2f2 >2014-01-30 04:07:51,231 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:07:52,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 473f3fdd >2014-01-30 04:07:52,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 473f3fdd >2014-01-30 04:07:52,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30956622 >2014-01-30 04:07:52,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e73376f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8cf53da8}, log id: 30956622 >2014-01-30 04:07:56,251 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:07:57,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-4) START, GetGlusterVolumeRemoveBricksStatusVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a5c0cb0 >2014-01-30 04:07:57,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeRemoveBricksStatusVDSCommand] (ajp-/127.0.0.1:8702-4) FINISH, GetGlusterVolumeRemoveBricksStatusVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeTaskStatusEntity@74411c6a, log id: 7a5c0cb0 >2014-01-30 04:07:57,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5bbfdcf1 >2014-01-30 04:07:58,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5bbfdcf1 >2014-01-30 04:07:58,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7662f273 >2014-01-30 04:07:58,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96e1d32b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e688a61}, log id: 7662f273 >2014-01-30 04:08:01,274 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:08:03,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d4aad8e >2014-01-30 04:08:04,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2d4aad8e >2014-01-30 04:08:04,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: fd3ee36 >2014-01-30 04:08:04,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dea9d60e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5594ec58}, log id: fd3ee36 >2014-01-30 04:08:06,296 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:08:09,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 649df456 >2014-01-30 04:08:10,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 649df456 >2014-01-30 04:08:10,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 61ba418b >2014-01-30 04:08:10,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d4490da, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36c3fa85}, log id: 61ba418b >2014-01-30 04:08:11,319 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-73) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:08:15,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a434ac4 >2014-01-30 04:08:15,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7a434ac4 >2014-01-30 04:08:15,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e28353 >2014-01-30 04:08:16,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93d26c46, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b3da812}, log id: e28353 >2014-01-30 04:08:16,341 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:08:18,565 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-98) [e73a3c6] No up server in cluster >2014-01-30 04:08:18,565 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-98) [e73a3c6] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:08:18,568 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-98) [e73a3c6] No up server in cluster >2014-01-30 04:08:18,569 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-98) [e73a3c6] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:08:18,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 1cc0c58 >2014-01-30 04:08:19,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 1cc0c58 >2014-01-30 04:08:21,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 55eb8a72 >2014-01-30 04:08:21,360 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:08:21,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 55eb8a72 >2014-01-30 04:08:21,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 739869b7 >2014-01-30 04:08:22,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98c26ab8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b07ac8b0}, log id: 739869b7 >2014-01-30 04:08:26,375 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:08:27,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c39f715 >2014-01-30 04:08:27,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5c39f715 >2014-01-30 04:08:27,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46608232 >2014-01-30 04:08:27,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aea36d53, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@370c0ee7}, log id: 46608232 >2014-01-30 04:08:31,398 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:08:32,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e9a7d68 >2014-01-30 04:08:33,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1e9a7d68 >2014-01-30 04:08:33,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27fd839f >2014-01-30 04:08:33,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fed776ec, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46fab72d}, log id: 27fd839f >2014-01-30 04:08:36,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:08:38,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f1671 >2014-01-30 04:08:39,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4f1671 >2014-01-30 04:08:39,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f6864e2 >2014-01-30 04:08:39,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd64cabd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc3e4c6a}, log id: 1f6864e2 >2014-01-30 04:08:41,439 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:08:44,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2176e77a >2014-01-30 04:08:44,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2176e77a >2014-01-30 04:08:44,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ce0dd6 >2014-01-30 04:08:45,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@484dd64e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c717d05}, log id: 5ce0dd6 >2014-01-30 04:08:46,461 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:08:50,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 477c411a >2014-01-30 04:08:50,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 477c411a >2014-01-30 04:08:50,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 121c302a >2014-01-30 04:08:51,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d772ba9a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7841e6}, log id: 121c302a >2014-01-30 04:08:51,481 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:08:56,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 788ddec0 >2014-01-30 04:08:56,502 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:08:56,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 788ddec0 >2014-01-30 04:08:56,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5997b04a >2014-01-30 04:08:56,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72c69e16, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@332b0de1}, log id: 5997b04a >2014-01-30 04:09:01,520 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:09:01,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4dcd53fa >2014-01-30 04:09:02,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4dcd53fa >2014-01-30 04:09:02,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 486dfc23 >2014-01-30 04:09:02,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab1ff754, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d82a0a3}, log id: 486dfc23 >2014-01-30 04:09:06,541 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:09:07,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 61c2c339 >2014-01-30 04:09:08,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 61c2c339 >2014-01-30 04:09:08,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 55b9bf6d >2014-01-30 04:09:08,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8c2ef4f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2715365}, log id: 55b9bf6d >2014-01-30 04:09:11,562 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:09:13,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65a0d6b0 >2014-01-30 04:09:14,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 65a0d6b0 >2014-01-30 04:09:14,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f5fe09c >2014-01-30 04:09:14,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59d482f1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2a9012a}, log id: 4f5fe09c >2014-01-30 04:09:16,584 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:09:19,136 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-97) [717bad08] No up server in cluster >2014-01-30 04:09:19,136 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-97) [717bad08] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:09:19,140 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-97) [717bad08] No up server in cluster >2014-01-30 04:09:19,140 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-97) [717bad08] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:09:19,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 16793919 >2014-01-30 04:09:19,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ce285c >2014-01-30 04:09:19,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 16793919 >2014-01-30 04:09:19,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3ce285c >2014-01-30 04:09:19,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44a5dea7 >2014-01-30 04:09:20,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8cd8f5a3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a017de2}, log id: 44a5dea7 >2014-01-30 04:09:21,605 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:09:25,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33a88fc4 >2014-01-30 04:09:25,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 33a88fc4 >2014-01-30 04:09:25,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d1ffbf5 >2014-01-30 04:09:25,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f9f340b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19297d01}, log id: 7d1ffbf5 >2014-01-30 04:09:26,629 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:09:31,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 624b851a >2014-01-30 04:09:31,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 624b851a >2014-01-30 04:09:31,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7551e0b5 >2014-01-30 04:09:31,649 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-73) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:09:31,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1080828c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a3108d4}, log id: 7551e0b5 >2014-01-30 04:09:36,667 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:09:36,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4fdcb32b >2014-01-30 04:09:37,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4fdcb32b >2014-01-30 04:09:37,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3dcabfcb >2014-01-30 04:09:37,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cabe0694, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d52c1cd}, log id: 3dcabfcb >2014-01-30 04:09:41,687 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:09:42,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30eef857 >2014-01-30 04:09:43,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 30eef857 >2014-01-30 04:09:43,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 535421da >2014-01-30 04:09:43,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2901f97a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e122668}, log id: 535421da >2014-01-30 04:09:45,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 7f9af8c7 >2014-01-30 04:09:45,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1b6a0c42, log id: 7f9af8c7 >2014-01-30 04:09:45,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 4f4acf1d >2014-01-30 04:09:45,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@55775466, log id: 4f4acf1d >2014-01-30 04:09:46,707 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-20) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:09:48,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22d78ef2 >2014-01-30 04:09:49,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 22d78ef2 >2014-01-30 04:09:49,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 63a4e7c1 >2014-01-30 04:09:49,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5a80350, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@161ecf44}, log id: 63a4e7c1 >2014-01-30 04:09:51,730 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:09:54,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6be9a787 >2014-01-30 04:09:54,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6be9a787 >2014-01-30 04:09:54,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4270ff5a >2014-01-30 04:09:55,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3b83532, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4dd5c8}, log id: 4270ff5a >2014-01-30 04:09:56,750 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-67) [163d00df] Autorecovering 1 hosts >2014-01-30 04:10:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-67) [163d00df] Autorecovering hosts id: 80dfb2ba-85ca-41d0-9af5-8468c89e2354, name : host1 >2014-01-30 04:10:00,012 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-67) [6a8c240e] Lock Acquired to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 04:10:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-67) [6a8c240e] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 04:10:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-67) [6a8c240e] Before acquiring lock in order to prevent monitoring for host host1 from data-center Default >2014-01-30 04:10:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-67) [6a8c240e] Lock acquired, from now a monitoring of host will be skipped for host host1 from data-center Default >2014-01-30 04:10:00,020 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-67) [6a8c240e] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=Unassigned, nonOperationalReason=NONE), log id: 6a432f36 >2014-01-30 04:10:00,026 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-67) [6a8c240e] FINISH, SetVdsStatusVDSCommand, log id: 6a432f36 >2014-01-30 04:10:00,029 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-67) [6a8c240e] START, ActivateVdsVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 3edcaac9 >2014-01-30 04:10:00,087 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-67) [6a8c240e] START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, vds=Host[host1]), log id: 16ce5197 >2014-01-30 04:10:00,102 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-67) [6a8c240e] FINISH, GetHardwareInfoVDSCommand, log id: 16ce5197 >2014-01-30 04:10:00,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f442e29 >2014-01-30 04:10:00,143 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-67) [411f8743] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 04:10:00,146 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-67) [411f8743] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=NonOperational, nonOperationalReason=NETWORK_UNREACHABLE), log id: 74a0faba >2014-01-30 04:10:00,151 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-67) [411f8743] FINISH, SetVdsStatusVDSCommand, log id: 74a0faba >2014-01-30 04:10:00,157 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-67) [411f8743] Host host1 is set to Non-Operational, it is missing the following networks: ovirtmgmt >2014-01-30 04:10:00,167 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-67) [411f8743] Correlation ID: 411f8743, Job ID: 10bf8436-722d-4268-b290-854fd1cbd858, Call Stack: null, Custom Event ID: -1, Message: Host host1 does not comply with the cluster test_1 networks, the following networks are missing on host: 'ovirtmgmt' >2014-01-30 04:10:00,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [411f8743] START, GlusterServersListVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 27c18b4d >2014-01-30 04:10:00,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f442e29 >2014-01-30 04:10:00,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64533969 >2014-01-30 04:10:00,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [411f8743] FINISH, GlusterServersListVDSCommand, return: [10.70.37.220:CONNECTED, 10.70.37.158:CONNECTED], log id: 27c18b4d >2014-01-30 04:10:00,635 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 04:10:00,636 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, ActivateVdsVDSCommand, return: Host[host1], log id: 3edcaac9 >2014-01-30 04:10:00,658 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] Activate finished. Lock released. Monitoring can run now for host host1 from data-center Default >2014-01-30 04:10:00,660 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] Lock freed to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 04:10:00,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@317eab26, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a210e92b}, log id: 64533969 >2014-01-30 04:10:01,770 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:10:05,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c3fb0c0 >2014-01-30 04:10:06,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2c3fb0c0 >2014-01-30 04:10:06,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 55d38ce1 >2014-01-30 04:10:06,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@711f5db9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7e740fd}, log id: 55d38ce1 >2014-01-30 04:10:06,789 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:10:11,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d862165 >2014-01-30 04:10:11,808 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:10:12,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: d862165 >2014-01-30 04:10:12,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 70e20628 >2014-01-30 04:10:12,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dad92aea, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8503578f}, log id: 70e20628 >2014-01-30 04:10:16,826 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:10:17,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ec65c73 >2014-01-30 04:10:18,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2ec65c73 >2014-01-30 04:10:18,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10835a5c >2014-01-30 04:10:18,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30b3ef01, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d07948f6}, log id: 10835a5c >2014-01-30 04:10:19,679 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-83) [7bf85f46] No up server in cluster >2014-01-30 04:10:19,679 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-83) [7bf85f46] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:10:19,682 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-83) [7bf85f46] No up server in cluster >2014-01-30 04:10:19,682 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-83) [7bf85f46] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:10:19,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 61f5a7e8 >2014-01-30 04:10:20,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 61f5a7e8 >2014-01-30 04:10:21,846 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:10:23,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1976e561 >2014-01-30 04:10:23,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1976e561 >2014-01-30 04:10:23,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40bd53d9 >2014-01-30 04:10:24,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb3c37d8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4bdf4515}, log id: 40bd53d9 >2014-01-30 04:10:26,871 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:10:29,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58c81a96 >2014-01-30 04:10:29,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 58c81a96 >2014-01-30 04:10:29,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 519166d5 >2014-01-30 04:10:30,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42c12a73, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55eb9d7e}, log id: 519166d5 >2014-01-30 04:10:31,891 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:10:35,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7342f5d7 >2014-01-30 04:10:35,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7342f5d7 >2014-01-30 04:10:35,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 748d8969 >2014-01-30 04:10:35,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d659adbe, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10158526}, log id: 748d8969 >2014-01-30 04:10:36,913 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:10:40,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [4f6d8cf4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27d69fd1 >2014-01-30 04:10:41,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [4f6d8cf4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 27d69fd1 >2014-01-30 04:10:41,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [4f6d8cf4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3cce7a5c >2014-01-30 04:10:41,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [4f6d8cf4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da845322, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@618fb204}, log id: 3cce7a5c >2014-01-30 04:10:41,932 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:10:46,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27fa5f7f >2014-01-30 04:10:46,954 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-50) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:10:47,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 27fa5f7f >2014-01-30 04:10:47,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c3f2a12 >2014-01-30 04:10:47,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d115ebb3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c492689}, log id: 2c3f2a12 >2014-01-30 04:10:51,974 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:10:52,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 367cbdcd >2014-01-30 04:10:53,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 367cbdcd >2014-01-30 04:10:53,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a655584 >2014-01-30 04:10:53,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfeabe62, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84dc136b}, log id: 2a655584 >2014-01-30 04:10:56,997 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:10:58,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 561ff9c7 >2014-01-30 04:10:58,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 561ff9c7 >2014-01-30 04:10:58,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a1f5dfd >2014-01-30 04:10:59,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9520824d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf768181}, log id: a1f5dfd >2014-01-30 04:11:02,016 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:11:04,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41cea7b9 >2014-01-30 04:11:04,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 41cea7b9 >2014-01-30 04:11:04,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15e849a1 >2014-01-30 04:11:04,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe23d215, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4993de7c}, log id: 15e849a1 >2014-01-30 04:11:07,034 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:11:09,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a40f5a9 >2014-01-30 04:11:10,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5a40f5a9 >2014-01-30 04:11:10,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 737941e4 >2014-01-30 04:11:10,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fd952d6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41435938}, log id: 737941e4 >2014-01-30 04:11:12,055 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:11:15,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 61a5bff1 >2014-01-30 04:11:16,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 61a5bff1 >2014-01-30 04:11:16,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e5c50b >2014-01-30 04:11:16,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b976e6ae, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2288c9f}, log id: 5e5c50b >2014-01-30 04:11:17,076 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:11:20,269 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-37) [2a3b7700] No up server in cluster >2014-01-30 04:11:20,269 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:11:20,272 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-37) [2a3b7700] No up server in cluster >2014-01-30 04:11:20,273 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:11:20,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 1c26699f >2014-01-30 04:11:20,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 1c26699f >2014-01-30 04:11:21,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32b0bff9 >2014-01-30 04:11:22,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 32b0bff9 >2014-01-30 04:11:22,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8828683 >2014-01-30 04:11:22,096 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:11:22,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a83c514c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed23d1eb}, log id: 8828683 >2014-01-30 04:11:27,113 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:11:27,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13e6cac4 >2014-01-30 04:11:27,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 13e6cac4 >2014-01-30 04:11:27,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9a714c2 >2014-01-30 04:11:28,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9b22540, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa8812ac}, log id: 9a714c2 >2014-01-30 04:11:32,133 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:11:33,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41dc8b32 >2014-01-30 04:11:33,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 41dc8b32 >2014-01-30 04:11:33,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24ac74d2 >2014-01-30 04:11:33,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be0af88f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99b2c7df}, log id: 24ac74d2 >2014-01-30 04:11:37,154 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:11:38,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 716138b9 >2014-01-30 04:11:39,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 716138b9 >2014-01-30 04:11:39,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27dc6d2f >2014-01-30 04:11:39,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f563351, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f428ab63}, log id: 27dc6d2f >2014-01-30 04:11:42,174 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:11:44,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72199fd1 >2014-01-30 04:11:45,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 72199fd1 >2014-01-30 04:11:45,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66d983c9 >2014-01-30 04:11:45,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6b041b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@659599fb}, log id: 66d983c9 >2014-01-30 04:11:47,190 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:11:50,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6fb211a5 >2014-01-30 04:11:51,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6fb211a5 >2014-01-30 04:11:51,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 234cc52 >2014-01-30 04:11:51,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@858c48b3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efb6b218}, log id: 234cc52 >2014-01-30 04:11:52,212 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:11:56,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2990db3c >2014-01-30 04:11:56,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2990db3c >2014-01-30 04:11:56,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31d3dde3 >2014-01-30 04:11:57,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4999ff8e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@526bd37a}, log id: 31d3dde3 >2014-01-30 04:11:57,232 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:12:02,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ac39db >2014-01-30 04:12:02,253 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:12:02,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4ac39db >2014-01-30 04:12:02,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e160e95 >2014-01-30 04:12:02,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@531c86d8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cddbee7}, log id: 7e160e95 >2014-01-30 04:12:07,270 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:12:07,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d0a4934 >2014-01-30 04:12:08,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6d0a4934 >2014-01-30 04:12:08,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 295512c2 >2014-01-30 04:12:08,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62a952d0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fffb6fa}, log id: 295512c2 >2014-01-30 04:12:12,291 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:12:13,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f0ca87e >2014-01-30 04:12:14,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: f0ca87e >2014-01-30 04:12:14,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e0a3301 >2014-01-30 04:12:14,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57a2077e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c84b2382}, log id: 4e0a3301 >2014-01-30 04:12:17,311 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:12:19,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3802ddff >2014-01-30 04:12:20,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3802ddff >2014-01-30 04:12:20,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f33cb67 >2014-01-30 04:12:20,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b30434a3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@818498f2}, log id: 4f33cb67 >2014-01-30 04:12:20,844 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) [65dfb813] No up server in cluster >2014-01-30 04:12:20,845 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) [65dfb813] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:12:20,848 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) [65dfb813] No up server in cluster >2014-01-30 04:12:20,848 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) [65dfb813] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:12:20,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 4a8b0db2 >2014-01-30 04:12:21,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4a8b0db2 >2014-01-30 04:12:22,331 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:12:25,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1fe7a82e >2014-01-30 04:12:25,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1fe7a82e >2014-01-30 04:12:25,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 509d0e6b >2014-01-30 04:12:26,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae551365, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdfcc17f}, log id: 509d0e6b >2014-01-30 04:12:27,354 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:12:31,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c9f6766 >2014-01-30 04:12:31,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5c9f6766 >2014-01-30 04:12:31,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f2a86b5 >2014-01-30 04:12:32,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a02ef71, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c89f95b0}, log id: 1f2a86b5 >2014-01-30 04:12:32,375 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:12:37,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5619341f >2014-01-30 04:12:37,397 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:12:37,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5619341f >2014-01-30 04:12:37,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3925415d >2014-01-30 04:12:37,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a9fb29a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@815f01e9}, log id: 3925415d >2014-01-30 04:12:42,416 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:12:42,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41dd5f3e >2014-01-30 04:12:43,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 41dd5f3e >2014-01-30 04:12:43,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 139d8178 >2014-01-30 04:12:43,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76d8a160, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38aaf179}, log id: 139d8178 >2014-01-30 04:12:47,436 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:12:48,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f5f70c6 >2014-01-30 04:12:49,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f5f70c6 >2014-01-30 04:12:49,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20d415f >2014-01-30 04:12:49,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b244cdc0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b8ed675}, log id: 20d415f >2014-01-30 04:12:52,458 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:12:54,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3bd2d9b1 >2014-01-30 04:12:55,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3bd2d9b1 >2014-01-30 04:12:55,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ced8d8f >2014-01-30 04:12:55,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86ea68c9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6f72722}, log id: 3ced8d8f >2014-01-30 04:12:57,478 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:13:00,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f2c094f >2014-01-30 04:13:00,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5f2c094f >2014-01-30 04:13:00,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d72f1f >2014-01-30 04:13:01,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9845efd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0aa7fe7}, log id: 1d72f1f >2014-01-30 04:13:02,493 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:13:06,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52226f4f >2014-01-30 04:13:06,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 52226f4f >2014-01-30 04:13:06,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e88a88a >2014-01-30 04:13:06,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f8b4496, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28be8170}, log id: 6e88a88a >2014-01-30 04:13:07,514 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:13:12,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d082986 >2014-01-30 04:13:12,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4d082986 >2014-01-30 04:13:12,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4699dff7 >2014-01-30 04:13:12,534 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:13:12,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abd83c42, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc7220c9}, log id: 4699dff7 >2014-01-30 04:13:17,550 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:13:17,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b82ee26 >2014-01-30 04:13:18,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1b82ee26 >2014-01-30 04:13:18,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 777adac4 >2014-01-30 04:13:18,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65a683c3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a697dd3e}, log id: 777adac4 >2014-01-30 04:13:21,395 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) [68161e48] No up server in cluster >2014-01-30 04:13:21,395 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) [68161e48] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:13:21,398 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) [68161e48] No up server in cluster >2014-01-30 04:13:21,398 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) [68161e48] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:13:21,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 5541a6b2 >2014-01-30 04:13:21,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 5541a6b2 >2014-01-30 04:13:22,571 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:13:23,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c4a61a2 >2014-01-30 04:13:24,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3c4a61a2 >2014-01-30 04:13:24,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c0489be >2014-01-30 04:13:24,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c582182, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab16f562}, log id: 1c0489be >2014-01-30 04:13:27,593 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-4) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:13:29,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48f31a2c >2014-01-30 04:13:29,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 48f31a2c >2014-01-30 04:13:29,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7558176f >2014-01-30 04:13:30,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49a3d8ef, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ed92e9f}, log id: 7558176f >2014-01-30 04:13:32,613 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:13:35,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b5b549 >2014-01-30 04:13:35,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7b5b549 >2014-01-30 04:13:35,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 55ef1ba3 >2014-01-30 04:13:35,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ff0d037, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@683fec35}, log id: 55ef1ba3 >2014-01-30 04:13:37,636 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:13:41,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ed79185 >2014-01-30 04:13:41,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6ed79185 >2014-01-30 04:13:41,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f447a2c >2014-01-30 04:13:41,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@841de5f1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d229c036}, log id: 1f447a2c >2014-01-30 04:13:42,656 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:13:46,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e1cca44 >2014-01-30 04:13:47,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6e1cca44 >2014-01-30 04:13:47,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38385065 >2014-01-30 04:13:47,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd003184, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c933299d}, log id: 38385065 >2014-01-30 04:13:47,674 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:13:52,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c166f39 >2014-01-30 04:13:52,696 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:13:53,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5c166f39 >2014-01-30 04:13:53,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ca0033a >2014-01-30 04:13:53,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a1c74be, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@984935a}, log id: 3ca0033a >2014-01-30 04:13:57,712 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:13:58,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3114b8d9 >2014-01-30 04:13:58,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3114b8d9 >2014-01-30 04:13:58,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 45c78f15 >2014-01-30 04:13:59,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f826f122, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b55b325f}, log id: 45c78f15 >2014-01-30 04:14:02,732 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:14:04,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4dbdf074 >2014-01-30 04:14:04,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4dbdf074 >2014-01-30 04:14:04,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44cf9316 >2014-01-30 04:14:05,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46066f59, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d756de3}, log id: 44cf9316 >2014-01-30 04:14:07,754 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:14:10,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3556c34e >2014-01-30 04:14:10,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3556c34e >2014-01-30 04:14:10,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4487ed1e >2014-01-30 04:14:10,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8c04b09, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c162aa2}, log id: 4487ed1e >2014-01-30 04:14:12,776 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:14:15,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b8bdd33 >2014-01-30 04:14:16,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: b8bdd33 >2014-01-30 04:14:16,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3070acca >2014-01-30 04:14:16,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae1abc4b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2454b06}, log id: 3070acca >2014-01-30 04:14:17,795 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:14:21,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50b2d6cf >2014-01-30 04:14:21,964 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-66) [399e7730] No up server in cluster >2014-01-30 04:14:21,964 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-66) [399e7730] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:14:21,965 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-66) [399e7730] No up server in cluster >2014-01-30 04:14:21,965 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-66) [399e7730] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:14:21,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5fe19f40 >2014-01-30 04:14:22,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 50b2d6cf >2014-01-30 04:14:22,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 459325d8 >2014-01-30 04:14:22,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) [399e7730] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 5fe19f40 >2014-01-30 04:14:22,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e81dea43, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0f62145}, log id: 459325d8 >2014-01-30 04:14:22,815 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:14:27,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 715c4a3e >2014-01-30 04:14:27,836 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:14:27,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 715c4a3e >2014-01-30 04:14:28,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78f05168 >2014-01-30 04:14:28,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [38d7b473] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aaac71e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f02e1fa}, log id: 78f05168 >2014-01-30 04:14:32,857 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:14:33,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53ef3814 >2014-01-30 04:14:33,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 53ef3814 >2014-01-30 04:14:33,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27f1a44d >2014-01-30 04:14:34,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a19d6bc3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71d7aebc}, log id: 27f1a44d >2014-01-30 04:14:37,879 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:14:39,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c50da7f >2014-01-30 04:14:39,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5c50da7f >2014-01-30 04:14:39,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a9747d >2014-01-30 04:14:39,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b29f8235, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb43611e}, log id: 7a9747d >2014-01-30 04:14:42,897 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:14:44,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ac33270 >2014-01-30 04:14:45,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2ac33270 >2014-01-30 04:14:45,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52069620 >2014-01-30 04:14:45,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3143aa0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75752d75}, log id: 52069620 >2014-01-30 04:14:45,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77c5f780 >2014-01-30 04:14:46,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@650ad49b, log id: 77c5f780 >2014-01-30 04:14:46,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a0c3ff0 >2014-01-30 04:14:46,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@77ee26be, log id: 2a0c3ff0 >2014-01-30 04:14:47,918 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:14:50,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c73b366 >2014-01-30 04:14:51,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5c73b366 >2014-01-30 04:14:51,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5090bec7 >2014-01-30 04:14:51,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af02611e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e67bc414}, log id: 5090bec7 >2014-01-30 04:14:52,938 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-68) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:14:56,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b552c5 >2014-01-30 04:14:57,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7b552c5 >2014-01-30 04:14:57,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72e88cb0 >2014-01-30 04:14:57,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83d2d058, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdcd7e98}, log id: 72e88cb0 >2014-01-30 04:14:57,959 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:15:00,009 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-66) [399e7730] Autorecovering 1 hosts >2014-01-30 04:15:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-66) [399e7730] Autorecovering hosts id: 80dfb2ba-85ca-41d0-9af5-8468c89e2354, name : host1 >2014-01-30 04:15:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-66) [42642557] Lock Acquired to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 04:15:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-66) [42642557] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 04:15:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-66) [42642557] Before acquiring lock in order to prevent monitoring for host host1 from data-center Default >2014-01-30 04:15:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-66) [42642557] Lock acquired, from now a monitoring of host will be skipped for host host1 from data-center Default >2014-01-30 04:15:00,019 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-66) [42642557] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=Unassigned, nonOperationalReason=NONE), log id: 272abee2 >2014-01-30 04:15:00,023 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-66) [42642557] FINISH, SetVdsStatusVDSCommand, log id: 272abee2 >2014-01-30 04:15:00,025 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-66) [42642557] START, ActivateVdsVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 6e3adf85 >2014-01-30 04:15:00,106 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-66) [42642557] START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, vds=Host[host1]), log id: 3c5fae10 >2014-01-30 04:15:00,121 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-66) [42642557] FINISH, GetHardwareInfoVDSCommand, log id: 3c5fae10 >2014-01-30 04:15:00,155 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-66) [25c39a1f] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 04:15:00,158 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-66) [25c39a1f] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=NonOperational, nonOperationalReason=NETWORK_UNREACHABLE), log id: 7066acf4 >2014-01-30 04:15:00,162 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-66) [25c39a1f] FINISH, SetVdsStatusVDSCommand, log id: 7066acf4 >2014-01-30 04:15:00,168 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-66) [25c39a1f] Host host1 is set to Non-Operational, it is missing the following networks: ovirtmgmt >2014-01-30 04:15:00,179 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-66) [25c39a1f] Correlation ID: 25c39a1f, Job ID: 478679c3-d5b8-46a8-a51a-8e0fde11708b, Call Stack: null, Custom Event ID: -1, Message: Host host1 does not comply with the cluster test_1 networks, the following networks are missing on host: 'ovirtmgmt' >2014-01-30 04:15:00,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [25c39a1f] START, GlusterServersListVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 72fb287b >2014-01-30 04:15:00,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [25c39a1f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.220:CONNECTED, 10.70.37.158:CONNECTED], log id: 72fb287b >2014-01-30 04:15:00,681 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 04:15:00,683 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, ActivateVdsVDSCommand, return: Host[host1], log id: 6e3adf85 >2014-01-30 04:15:00,707 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] Activate finished. Lock released. Monitoring can run now for host host1 from data-center Default >2014-01-30 04:15:00,709 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] Lock freed to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 04:15:02,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 674474c9 >2014-01-30 04:15:02,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 674474c9 >2014-01-30 04:15:02,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2fbbf81c >2014-01-30 04:15:02,977 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:15:03,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abb77647, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62325aaa}, log id: 2fbbf81c >2014-01-30 04:15:07,993 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:15:08,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 473cd444 >2014-01-30 04:15:08,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 473cd444 >2014-01-30 04:15:08,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d5728d9 >2014-01-30 04:15:08,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@875fa281, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@644f019f}, log id: 7d5728d9 >2014-01-30 04:15:13,013 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:15:13,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c87fb13 >2014-01-30 04:15:14,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c87fb13 >2014-01-30 04:15:14,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c8a1ea2 >2014-01-30 04:15:14,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c020d466, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d6d70a0}, log id: 1c8a1ea2 >2014-01-30 04:15:18,036 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:15:19,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54a69281 >2014-01-30 04:15:20,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 54a69281 >2014-01-30 04:15:20,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11da4425 >2014-01-30 04:15:20,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62d70ca6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8dc02eb5}, log id: 11da4425 >2014-01-30 04:15:22,472 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-62) [1449451c] No up server in cluster >2014-01-30 04:15:22,472 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-62) [1449451c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:15:22,475 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-62) [1449451c] No up server in cluster >2014-01-30 04:15:22,475 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-62) [1449451c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:15:22,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38fa8712 >2014-01-30 04:15:23,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 38fa8712 >2014-01-30 04:15:23,056 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:15:25,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 556ba388 >2014-01-30 04:15:26,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 556ba388 >2014-01-30 04:15:26,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53fa9caa >2014-01-30 04:15:26,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1bb04dbc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e138632a}, log id: 53fa9caa >2014-01-30 04:15:28,075 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-69) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:15:31,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 235d8a51 >2014-01-30 04:15:31,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 235d8a51 >2014-01-30 04:15:31,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 345a11b >2014-01-30 04:15:32,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c96635b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9766dab5}, log id: 345a11b >2014-01-30 04:15:33,095 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:15:37,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 449e4eeb >2014-01-30 04:15:37,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 449e4eeb >2014-01-30 04:15:37,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 318c2c0 >2014-01-30 04:15:37,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13303126, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a8846e5}, log id: 318c2c0 >2014-01-30 04:15:38,116 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:15:43,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1921c1bf >2014-01-30 04:15:43,133 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:15:43,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1921c1bf >2014-01-30 04:15:43,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ad93dc1 >2014-01-30 04:15:43,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@601c43d6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1fa2a2eb}, log id: 3ad93dc1 >2014-01-30 04:15:48,151 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:15:48,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33696c0f >2014-01-30 04:15:49,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 33696c0f >2014-01-30 04:15:49,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b4a2348 >2014-01-30 04:15:49,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c35aa4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52264b81}, log id: 4b4a2348 >2014-01-30 04:15:53,175 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:15:54,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 363189a6 >2014-01-30 04:15:55,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 363189a6 >2014-01-30 04:15:55,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4dae37e >2014-01-30 04:15:55,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@caa0712a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29d92da3}, log id: 4dae37e >2014-01-30 04:15:58,196 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:16:00,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c8c2d75 >2014-01-30 04:16:00,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3c8c2d75 >2014-01-30 04:16:00,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6541c15c >2014-01-30 04:16:01,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89e9f53c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d54fd49}, log id: 6541c15c >2014-01-30 04:16:03,215 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-73) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:16:06,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22d4bdf1 >2014-01-30 04:16:06,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 22d4bdf1 >2014-01-30 04:16:06,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d3fa806 >2014-01-30 04:16:07,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97b950f1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b2f22b7}, log id: 1d3fa806 >2014-01-30 04:16:08,236 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:16:12,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a6b17e8 >2014-01-30 04:16:12,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6a6b17e8 >2014-01-30 04:16:12,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1afd2555 >2014-01-30 04:16:12,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58d990f7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1480bae9}, log id: 1afd2555 >2014-01-30 04:16:13,257 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-68) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:16:17,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c132225 >2014-01-30 04:16:18,274 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-39) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:16:18,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4c132225 >2014-01-30 04:16:18,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6955bf69 >2014-01-30 04:16:18,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec535928, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8687b7b}, log id: 6955bf69 >2014-01-30 04:16:23,043 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] No up server in cluster >2014-01-30 04:16:23,043 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:16:23,046 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] No up server in cluster >2014-01-30 04:16:23,046 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:16:23,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 24214234 >2014-01-30 04:16:23,293 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:16:23,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 24214234 >2014-01-30 04:16:23,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ba0bf82 >2014-01-30 04:16:24,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1ba0bf82 >2014-01-30 04:16:24,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e1f4c9d >2014-01-30 04:16:24,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@367fb73, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b8fd858}, log id: e1f4c9d >2014-01-30 04:16:28,309 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:16:29,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 34a7721e >2014-01-30 04:16:30,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 34a7721e >2014-01-30 04:16:30,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 460f3173 >2014-01-30 04:16:30,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4e9a3be, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9216803c}, log id: 460f3173 >2014-01-30 04:16:33,644 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-59) [4f6d8cf4] START, GetHardwareInfoVDSCommand(HostName = 10.70.37.216, HostId = 93a4885f-f9f4-4fab-9d15-8e1904d19a99, vds=Host[10.70.37.216]), log id: 416f6cf8 >2014-01-30 04:16:33,717 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-59) [4f6d8cf4] FINISH, GetHardwareInfoVDSCommand, log id: 416f6cf8 >2014-01-30 04:16:33,749 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-59) [31a64551] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 93a4885f-f9f4-4fab-9d15-8e1904d19a99 Type: VDS >2014-01-30 04:16:33,752 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-59) [31a64551] START, SetVdsStatusVDSCommand(HostName = 10.70.37.216, HostId = 93a4885f-f9f4-4fab-9d15-8e1904d19a99, status=NonOperational, nonOperationalReason=NETWORK_UNREACHABLE), log id: 549b1b66 >2014-01-30 04:16:33,757 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-59) [31a64551] FINISH, SetVdsStatusVDSCommand, log id: 549b1b66 >2014-01-30 04:16:33,763 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-59) [31a64551] Host 10.70.37.216 is set to Non-Operational, it is missing the following networks: ovirtmgmt >2014-01-30 04:16:33,774 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-59) [31a64551] Correlation ID: 31a64551, Job ID: 1e01233f-c2c4-4927-a7e4-769f5b9c73ea, Call Stack: null, Custom Event ID: -1, Message: Host 10.70.37.216 does not comply with the cluster test_1 networks, the following networks are missing on host: 'ovirtmgmt' >2014-01-30 04:16:33,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [31a64551] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = 93a4885f-f9f4-4fab-9d15-8e1904d19a99), log id: 4fac6f70 >2014-01-30 04:16:34,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [31a64551] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 4fac6f70 >2014-01-30 04:16:34,327 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-59) [31a64551] START, GetHardwareInfoVDSCommand(HostName = 10.70.37.216, HostId = 93a4885f-f9f4-4fab-9d15-8e1904d19a99, vds=Host[10.70.37.216]), log id: 2247ecb7 >2014-01-30 04:16:34,341 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-59) [31a64551] FINISH, GetHardwareInfoVDSCommand, log id: 2247ecb7 >2014-01-30 04:16:34,372 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-59) [49e67545] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 93a4885f-f9f4-4fab-9d15-8e1904d19a99 Type: VDS >2014-01-30 04:16:34,374 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-59) [49e67545] START, SetVdsStatusVDSCommand(HostName = 10.70.37.216, HostId = 93a4885f-f9f4-4fab-9d15-8e1904d19a99, status=NonOperational, nonOperationalReason=NETWORK_UNREACHABLE), log id: 14a0862e >2014-01-30 04:16:34,378 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-59) [49e67545] FINISH, SetVdsStatusVDSCommand, log id: 14a0862e >2014-01-30 04:16:34,385 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-59) [49e67545] Host 10.70.37.216 is set to Non-Operational, it is missing the following networks: ovirtmgmt >2014-01-30 04:16:34,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [49e67545] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = 93a4885f-f9f4-4fab-9d15-8e1904d19a99), log id: 53bc529d >2014-01-30 04:16:34,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [49e67545] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 53bc529d >2014-01-30 04:16:34,879 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-59) [49e67545] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to NonOperational for host 10.70.37.216. >2014-01-30 04:16:34,900 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 93a4885f-f9f4-4fab-9d15-8e1904d19a99 Type: VDS >2014-01-30 04:16:34,902 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-59) [499ce58b] Host 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216 is already in NonOperational status. SetNonOperationalVds command is skipped. >2014-01-30 04:16:35,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60551fc1 >2014-01-30 04:16:35,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 60551fc1 >2014-01-30 04:16:35,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33b8bf0d >2014-01-30 04:16:36,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@122c5beb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d334f2b}, log id: 33b8bf0d >2014-01-30 04:16:41,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77b2def6 >2014-01-30 04:16:41,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 77b2def6 >2014-01-30 04:16:41,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d7cde73 >2014-01-30 04:16:41,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@949dd738, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8ebe4a1}, log id: 6d7cde73 >2014-01-30 04:16:44,655 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-9) Running command: LoginAdminUserCommand internal: false. >2014-01-30 04:16:44,664 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-9) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-01-30 04:16:44,708 INFO [org.ovirt.engine.core.bll.LoginUserCommand] (ajp-/127.0.0.1:8702-3) Running command: LoginUserCommand internal: false. >2014-01-30 04:16:44,712 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-01-30 04:16:47,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 70fc7998 >2014-01-30 04:16:47,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 70fc7998 >2014-01-30 04:16:47,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2844c046 >2014-01-30 04:16:47,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f47f88ca, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4dc7bb27}, log id: 2844c046 >2014-01-30 04:16:49,002 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] Command ListVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:16:49,011 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-52) [2414cdcb] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 04:16:50,503 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-11) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:16:52,047 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-10) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:16:52,292 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-3) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:16:52,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18213d77 >2014-01-30 04:16:53,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 18213d77 >2014-01-30 04:16:53,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e49fc1c >2014-01-30 04:16:53,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@939bc310, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32eab36}, log id: 1e49fc1c >2014-01-30 04:16:54,021 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:16:54,025 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 04:16:54,512 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-11) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:16:58,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a5f2424 >2014-01-30 04:16:59,035 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:16:59,039 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-6) [7c7776a1] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 04:16:59,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5a5f2424 >2014-01-30 04:16:59,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1afdddf4 >2014-01-30 04:16:59,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40bdc1a2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7b59e3d}, log id: 1afdddf4 >2014-01-30 04:17:04,048 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:17:04,052 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-65) [227486be] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 04:17:04,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11107926 >2014-01-30 04:17:04,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 11107926 >2014-01-30 04:17:04,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d802c52 >2014-01-30 04:17:05,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd9e9f79, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a028e77e}, log id: 3d802c52 >2014-01-30 04:17:09,061 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:17:09,064 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-81) [5c437990] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 04:17:10,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72016013 >2014-01-30 04:17:10,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 72016013 >2014-01-30 04:17:10,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2189046d >2014-01-30 04:17:11,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef333d23, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69a94680}, log id: 2189046d >2014-01-30 04:17:11,748 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (pool-5-thread-37) [46707fa9] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 04:17:11,752 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-37) [46707fa9] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354, status=PreparingForMaintenance, nonOperationalReason=NONE), log id: 73634ea5 >2014-01-30 04:17:11,758 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-37) [46707fa9] FINISH, SetVdsStatusVDSCommand, log id: 73634ea5 >2014-01-30 04:17:11,784 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (pool-5-thread-37) [46707fa9] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 04:17:11,792 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-37) [46707fa9] Correlation ID: 46707fa9, Job ID: 51bfa1a2-276b-4221-867f-e278fb018c7f, Call Stack: null, Custom Event ID: -1, Message: Host host1 was switched to Maintenance mode by admin@internal. >2014-01-30 04:17:13,706 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-59) [499ce58b] Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 80dfb2ba-85ca-41d0-9af5-8468c89e2354 : host1 >2014-01-30 04:17:13,730 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-5-thread-47) Clearing cache of pool: 5849b030-626e-47cb-ad90-3ce782d831b3 for problematic entities of VDS: host1. >2014-01-30 04:17:14,075 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:17:14,078 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-42) [cab85f1] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 04:17:16,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1256851d >2014-01-30 04:17:16,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1256851d >2014-01-30 04:17:16,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6587d634 >2014-01-30 04:17:16,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d05d604, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9e86855}, log id: 6587d634 >2014-01-30 04:17:19,089 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:17:19,093 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-35) [1f17c565] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 04:17:19,201 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-8) [381d033f] Lock Acquired to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 04:17:19,231 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-5-thread-37) [381d033f] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 Type: VDS >2014-01-30 04:17:19,259 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-37) [381d033f] START, RemoveVdsVDSCommand( HostId = 80dfb2ba-85ca-41d0-9af5-8468c89e2354), log id: 2ecd84d3 >2014-01-30 04:17:19,259 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-5-thread-37) [381d033f] vdsManager::disposing >2014-01-30 04:17:19,260 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-37) [381d033f] FINISH, RemoveVdsVDSCommand, log id: 2ecd84d3 >2014-01-30 04:17:19,265 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-37) [381d033f] Correlation ID: 381d033f, Call Stack: null, Custom Event ID: -1, Message: Host host1 was removed by admin@internal. >2014-01-30 04:17:19,265 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-5-thread-37) [381d033f] Lock freed to object EngineLock [exclusiveLocks= key: 80dfb2ba-85ca-41d0-9af5-8468c89e2354 value: VDS >, sharedLocks= ] >2014-01-30 04:17:19,537 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-3) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:17:20,621 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-1) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:17:21,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f886e3a >2014-01-30 04:17:22,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2f886e3a >2014-01-30 04:17:22,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5fe4812 >2014-01-30 04:17:22,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2973f763, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15181e9d}, log id: 5fe4812 >2014-01-30 04:17:23,623 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-22) [6f443883] No up server in cluster >2014-01-30 04:17:23,624 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-22) [6f443883] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:17:23,626 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-22) [6f443883] No up server in cluster >2014-01-30 04:17:23,626 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-22) [6f443883] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:17:23,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 3f0d5460 >2014-01-30 04:17:24,104 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:17:24,108 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-87) [6fd19374] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 04:17:24,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 3f0d5460 >2014-01-30 04:17:25,015 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-6) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:17:25,251 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-11) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:17:27,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d0ffff8 >2014-01-30 04:17:28,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: d0ffff8 >2014-01-30 04:17:28,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77f19707 >2014-01-30 04:17:28,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4ac6581, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f52bea49}, log id: 77f19707 >2014-01-30 04:17:29,120 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:17:29,124 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-14) [511b856] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 04:17:33,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 467a8df1 >2014-01-30 04:17:34,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 467a8df1 >2014-01-30 04:17:34,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a228d45 >2014-01-30 04:17:34,134 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:17:34,139 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-82) [4eafa082] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 04:17:34,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f95bbb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1f5fac6}, log id: a228d45 >2014-01-30 04:17:39,149 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:17:39,153 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 04:17:39,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a7a0310 >2014-01-30 04:17:39,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4a7a0310 >2014-01-30 04:17:39,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d22e98e >2014-01-30 04:17:40,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98906c0d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d16b5fc7}, log id: 4d22e98e >2014-01-30 04:17:44,165 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:17:44,166 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Server failed to respond, vds_id = 93a4885f-f9f4-4fab-9d15-8e1904d19a99, vds_name = 10.70.37.216, vm_count = 0, spm_status = None, non-responsive_timeout (seconds) = 60, error = java.net.SocketTimeoutException: connect timed out >2014-01-30 04:17:44,176 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Correlation ID: null, Call Stack: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.SocketTimeoutException: connect timed out > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:102) > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:28) > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:532) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:485) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.Refresh(VdsUpdateRunTimeInfo.java:336) > at org.ovirt.engine.core.vdsbroker.VdsManager.OnTimer(VdsManager.java:235) > at sun.reflect.GeneratedMethodAccessor56.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) >Caused by: java.net.SocketTimeoutException: connect timed out > at java.net.PlainSocketImpl.socketConnect(Native Method) > at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) > at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) > at java.net.Socket.connect(Socket.java:579) > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) > at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707) > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionManager.java:1361) > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387) > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) > at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397) > at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323) > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) > at com.sun.proxy.$Proxy113.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:225) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Host 10.70.37.216 is non responsive. >2014-01-30 04:17:44,181 INFO [org.ovirt.engine.core.bll.VdsEventListener] (pool-5-thread-43) [4cd69e9b] ResourceManager::vdsNotResponding entered for Host 93a4885f-f9f4-4fab-9d15-8e1904d19a99, 10.70.37.216 >2014-01-30 04:17:44,207 INFO [org.ovirt.engine.core.bll.SshSoftFencingCommand] (pool-5-thread-43) [4fd7e1c2] Running command: SshSoftFencingCommand internal: true. Entities affected : ID: 93a4885f-f9f4-4fab-9d15-8e1904d19a99 Type: VDS >2014-01-30 04:17:45,163 ERROR [org.ovirt.engine.core.bll.SshSoftFencingCommand] (pool-5-thread-43) [4fd7e1c2] SSH connection to host 10.70.37.216 failed: org.apache.sshd.common.RuntimeSshException: Failed to get the session.: org.apache.sshd.common.RuntimeSshException: Failed to get the session. > at org.apache.sshd.client.future.DefaultConnectFuture.getSession(DefaultConnectFuture.java:43) > at org.ovirt.engine.core.utils.ssh.SSHClient.connect(SSHClient.java:288) [utils.jar:] > at org.ovirt.engine.core.bll.utils.EngineSSHClient.connect(EngineSSHClient.java:59) [bll.jar:] > at org.ovirt.engine.core.bll.SshSoftFencingCommand.executeSshSoftFencingCommand(SshSoftFencingCommand.java:73) [bll.jar:] > at org.ovirt.engine.core.bll.SshSoftFencingCommand.executeCommand(SshSoftFencingCommand.java:43) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor84.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:235) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:374) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:218) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.VdsEventListener$1.run(VdsEventListener.java:134) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_45] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_45] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_45] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_45] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_45] >Caused by: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_45] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:735) [rt.jar:1.7.0_45] > at org.apache.mina.transport.socket.nio.NioSocketConnector.finishConnect(NioSocketConnector.java:224) [mina-core.jar:] > at org.apache.mina.transport.socket.nio.NioSocketConnector.finishConnect(NioSocketConnector.java:46) [mina-core.jar:] > at org.apache.mina.core.polling.AbstractPollingIoConnector.processConnections(AbstractPollingIoConnector.java:439) [mina-core.jar:] > at org.apache.mina.core.polling.AbstractPollingIoConnector.access$700(AbstractPollingIoConnector.java:64) [mina-core.jar:] > at org.apache.mina.core.polling.AbstractPollingIoConnector$Connector.run(AbstractPollingIoConnector.java:508) [mina-core.jar:] > at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:64) [mina-core.jar:] > ... 3 more > >2014-01-30 04:17:45,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2193de51 >2014-01-30 04:17:45,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2193de51 >2014-01-30 04:17:45,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1aa0241a >2014-01-30 04:17:45,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a6cd3a5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a18691e7}, log id: 1aa0241a >2014-01-30 04:17:49,203 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:17:51,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31533b3 >2014-01-30 04:17:51,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 31533b3 >2014-01-30 04:17:51,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ac5efbd >2014-01-30 04:17:51,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d481568, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d464fecb}, log id: 4ac5efbd >2014-01-30 04:17:54,218 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:17:56,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6fc92bbf >2014-01-30 04:17:57,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6fc92bbf >2014-01-30 04:17:57,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 363d2702 >2014-01-30 04:17:57,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed2774de, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffd31d0}, log id: 363d2702 >2014-01-30 04:17:59,228 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:18:02,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 246891e2 >2014-01-30 04:18:03,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 246891e2 >2014-01-30 04:18:03,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 87d06df >2014-01-30 04:18:03,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83ef0744, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c765412f}, log id: 87d06df >2014-01-30 04:18:04,243 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-51) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:18:08,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f46b46f >2014-01-30 04:18:08,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7f46b46f >2014-01-30 04:18:08,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e57be76 >2014-01-30 04:18:09,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2316ddf7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1160173f}, log id: 2e57be76 >2014-01-30 04:18:09,256 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:18:14,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 212fcee6 >2014-01-30 04:18:14,270 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:18:14,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 212fcee6 >2014-01-30 04:18:14,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8da5d4 >2014-01-30 04:18:15,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3ac9c3f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcc09878}, log id: 8da5d4 >2014-01-30 04:18:19,284 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:18:20,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9af0dc7 >2014-01-30 04:18:20,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 9af0dc7 >2014-01-30 04:18:20,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d4c953c >2014-01-30 04:18:20,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73e1fe9c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c246a7d}, log id: d4c953c >2014-01-30 04:18:24,192 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) [79e57d6f] No up server in cluster >2014-01-30 04:18:24,192 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:18:24,195 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) [79e57d6f] No up server in cluster >2014-01-30 04:18:24,195 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:18:24,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 704b20b4 >2014-01-30 04:18:24,296 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:18:24,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 704b20b4 >2014-01-30 04:18:25,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 143c7a02 >2014-01-30 04:18:26,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 143c7a02 >2014-01-30 04:18:26,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f4e5e03 >2014-01-30 04:18:26,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aef7e2fa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e78f298a}, log id: 5f4e5e03 >2014-01-30 04:18:29,310 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:18:31,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10c01098 >2014-01-30 04:18:32,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 10c01098 >2014-01-30 04:18:32,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36ca5ae >2014-01-30 04:18:32,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3be1cca1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1fdc9bd2}, log id: 36ca5ae >2014-01-30 04:18:34,324 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:18:37,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b2462cf >2014-01-30 04:18:37,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3b2462cf >2014-01-30 04:18:37,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2468bdf2 >2014-01-30 04:18:38,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@836b0227, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd2211cb}, log id: 2468bdf2 >2014-01-30 04:18:39,339 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:18:43,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 585446b1 >2014-01-30 04:18:43,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 585446b1 >2014-01-30 04:18:43,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79712759 >2014-01-30 04:18:44,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72561d67, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba742af0}, log id: 79712759 >2014-01-30 04:18:44,356 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:18:49,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33db0ba6 >2014-01-30 04:18:49,378 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:18:49,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 33db0ba6 >2014-01-30 04:18:49,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d755afc >2014-01-30 04:18:49,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@459413f8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9d1688f}, log id: 7d755afc >2014-01-30 04:18:54,396 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-45) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:18:54,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32f3a10e >2014-01-30 04:18:55,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 32f3a10e >2014-01-30 04:18:55,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e4a6528 >2014-01-30 04:18:55,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebc8275a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53a33ce7}, log id: 1e4a6528 >2014-01-30 04:18:59,416 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-56) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:19:00,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 509ce5a0 >2014-01-30 04:19:01,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 509ce5a0 >2014-01-30 04:19:01,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f2e3fc2 >2014-01-30 04:19:01,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cece4b1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8afa2b33}, log id: 1f2e3fc2 >2014-01-30 04:19:04,452 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:19:06,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29ee55b7 >2014-01-30 04:19:07,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 29ee55b7 >2014-01-30 04:19:07,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f07e2e0 >2014-01-30 04:19:07,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc305d9d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66de3b4a}, log id: 7f07e2e0 >2014-01-30 04:19:09,475 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:19:12,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e90a02f >2014-01-30 04:19:12,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7e90a02f >2014-01-30 04:19:12,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 604faa8e >2014-01-30 04:19:13,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9d2934d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14d26504}, log id: 604faa8e >2014-01-30 04:19:14,496 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:19:18,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35d6171e >2014-01-30 04:19:18,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 35d6171e >2014-01-30 04:19:18,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66e23b8c >2014-01-30 04:19:18,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62cac0a5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@910ccda1}, log id: 66e23b8c >2014-01-30 04:19:19,519 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:19:24,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2de2279d >2014-01-30 04:19:24,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2de2279d >2014-01-30 04:19:24,542 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:19:24,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2036f0c8 >2014-01-30 04:19:24,760 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) [69d5f07e] No up server in cluster >2014-01-30 04:19:24,760 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) [69d5f07e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:19:24,764 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) [69d5f07e] No up server in cluster >2014-01-30 04:19:24,764 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) [69d5f07e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:19:24,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 222e38a7 >2014-01-30 04:19:24,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f99bc274, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b1741cb}, log id: 2036f0c8 >2014-01-30 04:19:25,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 222e38a7 >2014-01-30 04:19:29,564 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:19:29,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3557a9a6 >2014-01-30 04:19:30,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3557a9a6 >2014-01-30 04:19:30,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a564902 >2014-01-30 04:19:30,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@908a485f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2e137a6}, log id: 6a564902 >2014-01-30 04:19:34,590 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:19:35,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33f8a410 >2014-01-30 04:19:36,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 33f8a410 >2014-01-30 04:19:36,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e3485e2 >2014-01-30 04:19:36,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5be45fe5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91a04da1}, log id: 2e3485e2 >2014-01-30 04:19:39,613 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:19:41,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11aa27fb >2014-01-30 04:19:41,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 11aa27fb >2014-01-30 04:19:42,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 332266af >2014-01-30 04:19:42,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1afab6e1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8e0ebc5}, log id: 332266af >2014-01-30 04:19:42,690 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] START, GetHardwareInfoVDSCommand(HostName = 10.70.37.216, HostId = 93a4885f-f9f4-4fab-9d15-8e1904d19a99, vds=Host[10.70.37.216]), log id: 4970546e >2014-01-30 04:19:42,704 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-86) [7893a550] FINISH, GetHardwareInfoVDSCommand, log id: 4970546e >2014-01-30 04:19:42,740 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-86) [7f9423f0] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 93a4885f-f9f4-4fab-9d15-8e1904d19a99 Type: VDS >2014-01-30 04:19:42,743 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-86) [7f9423f0] START, SetVdsStatusVDSCommand(HostName = 10.70.37.216, HostId = 93a4885f-f9f4-4fab-9d15-8e1904d19a99, status=NonOperational, nonOperationalReason=NETWORK_UNREACHABLE), log id: 441d5069 >2014-01-30 04:19:42,748 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-86) [7f9423f0] FINISH, SetVdsStatusVDSCommand, log id: 441d5069 >2014-01-30 04:19:42,756 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-86) [7f9423f0] Host 10.70.37.216 is set to Non-Operational, it is missing the following networks: ovirtmgmt >2014-01-30 04:19:42,766 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-86) [7f9423f0] Correlation ID: 7f9423f0, Job ID: c95b6627-9124-4265-92ad-4c941c500463, Call Stack: null, Custom Event ID: -1, Message: Host 10.70.37.216 does not comply with the cluster test_1 networks, the following networks are missing on host: 'ovirtmgmt' >2014-01-30 04:19:42,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7f9423f0] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = 93a4885f-f9f4-4fab-9d15-8e1904d19a99), log id: 323138a0 >2014-01-30 04:19:43,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [7f9423f0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 323138a0 >2014-01-30 04:19:43,273 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-86) [7f9423f0] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to NonOperational for host 10.70.37.216. >2014-01-30 04:19:43,292 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 93a4885f-f9f4-4fab-9d15-8e1904d19a99 Type: VDS >2014-01-30 04:19:43,294 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-86) [63ec361] Host 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216 is already in NonOperational status. SetNonOperationalVds command is skipped. >2014-01-30 04:19:46,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 3777dd69 >2014-01-30 04:19:46,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@37345580, log id: 3777dd69 >2014-01-30 04:19:46,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 4cd962d0 >2014-01-30 04:19:47,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6cf9ae4d, log id: 4cd962d0 >2014-01-30 04:19:47,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 187adfcc >2014-01-30 04:19:47,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 187adfcc >2014-01-30 04:19:47,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 577c7615 >2014-01-30 04:19:48,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a4255a9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8df0f78}, log id: 577c7615 >2014-01-30 04:19:53,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a7350ef >2014-01-30 04:19:53,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a7350ef >2014-01-30 04:19:53,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e4ae8d9 >2014-01-30 04:19:53,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0a2256, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8304ce18}, log id: e4ae8d9 >2014-01-30 04:19:58,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 216edd30 >2014-01-30 04:19:59,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 216edd30 >2014-01-30 04:19:59,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11301e2d >2014-01-30 04:19:59,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@752445de, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0d213ac}, log id: 11301e2d >2014-01-30 04:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-55) [38d7b473] Autorecovering 1 hosts >2014-01-30 04:20:00,010 INFO [org.ovirt.engine.core.bll.AutoRecoveryManager] (DefaultQuartzScheduler_Worker-55) [38d7b473] Autorecovering hosts id: 93a4885f-f9f4-4fab-9d15-8e1904d19a99, name : 10.70.37.216 >2014-01-30 04:20:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-55) [71ce959a] Lock Acquired to object EngineLock [exclusiveLocks= key: 93a4885f-f9f4-4fab-9d15-8e1904d19a99 value: VDS >, sharedLocks= ] >2014-01-30 04:20:00,013 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-55) [71ce959a] Running command: ActivateVdsCommand internal: true. Entities affected : ID: 93a4885f-f9f4-4fab-9d15-8e1904d19a99 Type: VDS >2014-01-30 04:20:00,014 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-55) [71ce959a] Before acquiring lock in order to prevent monitoring for host 10.70.37.216 from data-center Default >2014-01-30 04:20:00,014 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-55) [71ce959a] Lock acquired, from now a monitoring of host will be skipped for host 10.70.37.216 from data-center Default >2014-01-30 04:20:00,024 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-55) [71ce959a] START, SetVdsStatusVDSCommand(HostName = 10.70.37.216, HostId = 93a4885f-f9f4-4fab-9d15-8e1904d19a99, status=Unassigned, nonOperationalReason=NONE), log id: 2eadc947 >2014-01-30 04:20:00,029 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-55) [71ce959a] FINISH, SetVdsStatusVDSCommand, log id: 2eadc947 >2014-01-30 04:20:00,032 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-55) [71ce959a] START, ActivateVdsVDSCommand(HostName = 10.70.37.216, HostId = 93a4885f-f9f4-4fab-9d15-8e1904d19a99), log id: 5f8807b6 >2014-01-30 04:20:00,088 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-55) [71ce959a] START, GetHardwareInfoVDSCommand(HostName = 10.70.37.216, HostId = 93a4885f-f9f4-4fab-9d15-8e1904d19a99, vds=Host[10.70.37.216]), log id: 219f9448 >2014-01-30 04:20:00,103 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-55) [71ce959a] FINISH, GetHardwareInfoVDSCommand, log id: 219f9448 >2014-01-30 04:20:00,136 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-55) [4ba9cbb3] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 93a4885f-f9f4-4fab-9d15-8e1904d19a99 Type: VDS >2014-01-30 04:20:00,138 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-55) [4ba9cbb3] START, SetVdsStatusVDSCommand(HostName = 10.70.37.216, HostId = 93a4885f-f9f4-4fab-9d15-8e1904d19a99, status=NonOperational, nonOperationalReason=NETWORK_UNREACHABLE), log id: a805578 >2014-01-30 04:20:00,143 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-55) [4ba9cbb3] FINISH, SetVdsStatusVDSCommand, log id: a805578 >2014-01-30 04:20:00,148 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-55) [4ba9cbb3] Host 10.70.37.216 is set to Non-Operational, it is missing the following networks: ovirtmgmt >2014-01-30 04:20:00,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [4ba9cbb3] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = 93a4885f-f9f4-4fab-9d15-8e1904d19a99), log id: 331ba16f >2014-01-30 04:20:00,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [4ba9cbb3] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 331ba16f >2014-01-30 04:20:00,643 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 93a4885f-f9f4-4fab-9d15-8e1904d19a99 Type: VDS >2014-01-30 04:20:00,645 INFO [org.ovirt.engine.core.vdsbroker.ActivateVdsVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, ActivateVdsVDSCommand, return: Host[10.70.37.216], log id: 5f8807b6 >2014-01-30 04:20:00,675 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] Activate finished. Lock released. Monitoring can run now for host 10.70.37.216 from data-center Default >2014-01-30 04:20:00,681 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-55) [78fb20d6] Correlation ID: 71ce959a, Call Stack: null, Custom Event ID: -1, Message: Host 10.70.37.216 was autorecovered. >2014-01-30 04:20:00,681 INFO [org.ovirt.engine.core.bll.ActivateVdsCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] Lock freed to object EngineLock [exclusiveLocks= key: 93a4885f-f9f4-4fab-9d15-8e1904d19a99 value: VDS >, sharedLocks= ] >2014-01-30 04:20:04,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2acbba1 >2014-01-30 04:20:05,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2acbba1 >2014-01-30 04:20:05,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53cb7edd >2014-01-30 04:20:05,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61aaf892, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d2cb58b}, log id: 53cb7edd >2014-01-30 04:20:10,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1904577b >2014-01-30 04:20:10,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1904577b >2014-01-30 04:20:10,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1597e3fb >2014-01-30 04:20:11,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef1d4bdd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2eba877}, log id: 1597e3fb >2014-01-30 04:20:16,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ba483d >2014-01-30 04:20:16,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1ba483d >2014-01-30 04:20:16,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51d9ca40 >2014-01-30 04:20:17,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6060e38d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e8d4b89}, log id: 51d9ca40 >2014-01-30 04:20:22,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 248dfd0c >2014-01-30 04:20:22,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 248dfd0c >2014-01-30 04:20:22,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 95b0805 >2014-01-30 04:20:22,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60ccbf6e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d92b9e2d}, log id: 95b0805 >2014-01-30 04:20:25,311 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-11) [7cc81051] No up server in cluster >2014-01-30 04:20:25,311 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-11) [7cc81051] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:20:25,315 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-11) [7cc81051] No up server in cluster >2014-01-30 04:20:25,315 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-11) [7cc81051] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:20:25,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 57afb8f3 >2014-01-30 04:20:25,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 57afb8f3 >2014-01-30 04:20:27,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e225942 >2014-01-30 04:20:28,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e225942 >2014-01-30 04:20:28,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40feb8e1 >2014-01-30 04:20:28,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8e2af3c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5904820}, log id: 40feb8e1 >2014-01-30 04:20:33,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71a818f >2014-01-30 04:20:34,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 71a818f >2014-01-30 04:20:34,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a75eafe >2014-01-30 04:20:34,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f193eeaa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b473408}, log id: 5a75eafe >2014-01-30 04:20:39,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7163b292 >2014-01-30 04:20:40,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7163b292 >2014-01-30 04:20:40,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: efc8bd2 >2014-01-30 04:20:40,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@133cb16c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b09f37c}, log id: efc8bd2 >2014-01-30 04:20:40,728 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] Command GetStatsVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-01-30 04:20:40,729 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-7) [631bc2a6] vds::refreshVdsStats Failed getVdsStats, vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, error = VDSNetworkException: java.net.ConnectException: Connection refused >2014-01-30 04:20:40,736 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-7) [631bc2a6] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-01-30 04:20:43,745 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-01-30 04:20:43,749 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-1) [6b51df7a] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-01-30 04:20:45,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 600a7e06 >2014-01-30 04:20:45,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 600a7e06 >2014-01-30 04:20:45,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58f8b07e >2014-01-30 04:20:46,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a359d954, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@381948b4}, log id: 58f8b07e >2014-01-30 04:20:46,758 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-01-30 04:20:46,761 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-77) [7c43042] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-01-30 04:20:51,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78c3b1fe >2014-01-30 04:20:51,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 78c3b1fe >2014-01-30 04:20:51,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4be1fc2f >2014-01-30 04:20:51,775 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:20:51,780 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-96) [444c158d] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 04:20:51,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@371918af, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92bc1e5a}, log id: 4be1fc2f >2014-01-30 04:20:56,338 WARN [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (ajp-/127.0.0.1:8702-2) [3bdf9369] CanDoAction of action MaintenanceNumberOfVdss failed. Reasons:VAR__TYPE__HOST,VAR__ACTION__MAINTENANCE,VDS_CANNOT_MAINTENANCE_VDS_IS_NOT_OPERATIONAL >2014-01-30 04:20:56,789 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:20:56,795 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-59) [499ce58b] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 04:20:57,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43b35cc6 >2014-01-30 04:20:57,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43b35cc6 >2014-01-30 04:20:57,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1017b1f9 >2014-01-30 04:20:57,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd9320e0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@639341eb}, log id: 1017b1f9 >2014-01-30 04:21:01,805 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:21:01,809 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-62) [1449451c] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 04:21:02,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c40f986 >2014-01-30 04:21:03,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7c40f986 >2014-01-30 04:21:03,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: fc0367f >2014-01-30 04:21:03,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5ba3445, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d196d107}, log id: fc0367f >2014-01-30 04:21:06,819 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:21:06,822 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-87) [6fd19374] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 04:21:08,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8bb890c >2014-01-30 04:21:09,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 8bb890c >2014-01-30 04:21:09,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38da8386 >2014-01-30 04:21:09,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ae37c34, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df5dc181}, log id: 38da8386 >2014-01-30 04:21:11,833 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-56) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:21:11,837 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-56) Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 04:21:14,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ebc39e7 >2014-01-30 04:21:14,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4ebc39e7 >2014-01-30 04:21:14,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3db88a71 >2014-01-30 04:21:15,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7bf7f46, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d6d42ec}, log id: 3db88a71 >2014-01-30 04:21:16,846 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:21:16,850 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-2) [237643cb] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 04:21:19,857 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-01-30 04:21:19,859 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-19) [7a87389a] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-01-30 04:21:20,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19dad3a2 >2014-01-30 04:21:20,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 19dad3a2 >2014-01-30 04:21:20,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e7190e8 >2014-01-30 04:21:20,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4b021ea, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e758046e}, log id: 7e7190e8 >2014-01-30 04:21:22,870 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-01-30 04:21:22,874 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-61) [62f75f5f] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-01-30 04:21:25,883 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-12) [690883a1] No up server in cluster >2014-01-30 04:21:25,883 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-12) [690883a1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:21:25,886 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-12) [690883a1] No up server in cluster >2014-01-30 04:21:25,886 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-12) [690883a1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:21:25,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: a327c56 >2014-01-30 04:21:25,895 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-01-30 04:21:25,899 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-01-30 04:21:25,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 401bf3a5 >2014-01-30 04:21:26,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 401bf3a5 >2014-01-30 04:21:26,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77c35f33 >2014-01-30 04:21:26,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: a327c56 >2014-01-30 04:21:26,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d2493e2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@732c415f}, log id: 77c35f33 >2014-01-30 04:21:30,910 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:21:30,915 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-97) [717bad08] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 04:21:31,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d427319 >2014-01-30 04:21:32,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6d427319 >2014-01-30 04:21:32,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5476f165 >2014-01-30 04:21:32,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c281d7ad, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45fd698e}, log id: 5476f165 >2014-01-30 04:21:35,927 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:21:35,933 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-29) [520212b8] Failed to refresh VDS , vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 04:21:37,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 55efc02b >2014-01-30 04:21:38,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 55efc02b >2014-01-30 04:21:38,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 57aeb920 >2014-01-30 04:21:38,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47e83af4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b433d262}, log id: 57aeb920 >2014-01-30 04:21:40,943 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:21:40,944 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-42) [cab85f1] Server failed to respond, vds_id = 93a4885f-f9f4-4fab-9d15-8e1904d19a99, vds_name = 10.70.37.216, vm_count = 0, spm_status = None, non-responsive_timeout (seconds) = 60, error = java.net.SocketTimeoutException: connect timed out >2014-01-30 04:21:40,951 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-42) [cab85f1] Correlation ID: null, Call Stack: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.SocketTimeoutException: connect timed out > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:102) > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:28) > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:532) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:485) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.Refresh(VdsUpdateRunTimeInfo.java:336) > at org.ovirt.engine.core.vdsbroker.VdsManager.OnTimer(VdsManager.java:235) > at sun.reflect.GeneratedMethodAccessor56.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) >Caused by: java.net.SocketTimeoutException: connect timed out > at java.net.PlainSocketImpl.socketConnect(Native Method) > at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) > at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) > at java.net.Socket.connect(Socket.java:579) > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) > at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707) > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionManager.java:1361) > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387) > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) > at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397) > at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323) > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) > at com.sun.proxy.$Proxy113.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:225) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Host 10.70.37.216 is non responsive. >2014-01-30 04:21:40,956 INFO [org.ovirt.engine.core.bll.VdsEventListener] (pool-5-thread-37) [cab85f1] ResourceManager::vdsNotResponding entered for Host 93a4885f-f9f4-4fab-9d15-8e1904d19a99, 10.70.37.216 >2014-01-30 04:21:40,978 INFO [org.ovirt.engine.core.bll.SshSoftFencingCommand] (pool-5-thread-37) [1087d00f] Running command: SshSoftFencingCommand internal: true. Entities affected : ID: 93a4885f-f9f4-4fab-9d15-8e1904d19a99 Type: VDS >2014-01-30 04:21:41,943 ERROR [org.ovirt.engine.core.bll.SshSoftFencingCommand] (pool-5-thread-37) [1087d00f] SSH connection to host 10.70.37.216 failed: org.apache.sshd.common.RuntimeSshException: Failed to get the session.: org.apache.sshd.common.RuntimeSshException: Failed to get the session. > at org.apache.sshd.client.future.DefaultConnectFuture.getSession(DefaultConnectFuture.java:43) > at org.ovirt.engine.core.utils.ssh.SSHClient.connect(SSHClient.java:288) [utils.jar:] > at org.ovirt.engine.core.bll.utils.EngineSSHClient.connect(EngineSSHClient.java:59) [bll.jar:] > at org.ovirt.engine.core.bll.SshSoftFencingCommand.executeSshSoftFencingCommand(SshSoftFencingCommand.java:73) [bll.jar:] > at org.ovirt.engine.core.bll.SshSoftFencingCommand.executeCommand(SshSoftFencingCommand.java:43) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor84.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:235) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:374) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:218) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.VdsEventListener$1.run(VdsEventListener.java:134) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_45] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_45] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_45] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_45] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_45] >Caused by: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_45] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:735) [rt.jar:1.7.0_45] > at org.apache.mina.transport.socket.nio.NioSocketConnector.finishConnect(NioSocketConnector.java:224) [mina-core.jar:] > at org.apache.mina.transport.socket.nio.NioSocketConnector.finishConnect(NioSocketConnector.java:46) [mina-core.jar:] > at org.apache.mina.core.polling.AbstractPollingIoConnector.processConnections(AbstractPollingIoConnector.java:439) [mina-core.jar:] > at org.apache.mina.core.polling.AbstractPollingIoConnector.access$700(AbstractPollingIoConnector.java:64) [mina-core.jar:] > at org.apache.mina.core.polling.AbstractPollingIoConnector$Connector.run(AbstractPollingIoConnector.java:508) [mina-core.jar:] > at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:64) [mina-core.jar:] > ... 3 more > >2014-01-30 04:21:43,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c4570f2 >2014-01-30 04:21:43,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3c4570f2 >2014-01-30 04:21:43,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a3d4b7b >2014-01-30 04:21:44,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28db8860, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89c282d5}, log id: a3d4b7b >2014-01-30 04:21:45,968 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:21:49,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b757414 >2014-01-30 04:21:49,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: b757414 >2014-01-30 04:21:49,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f99575d >2014-01-30 04:21:49,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e754330d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26dafc12}, log id: 1f99575d >2014-01-30 04:21:50,984 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:21:54,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5855f33d >2014-01-30 04:21:55,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5855f33d >2014-01-30 04:21:55,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c2e1003 >2014-01-30 04:21:55,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b502b22, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7acfcb}, log id: 1c2e1003 >2014-01-30 04:21:56,001 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:22:00,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 711d0c3d >2014-01-30 04:22:01,016 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:22:01,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 711d0c3d >2014-01-30 04:22:01,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 440d4e9e >2014-01-30 04:22:01,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb7dc7e5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@217dd24d}, log id: 440d4e9e >2014-01-30 04:22:06,031 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:22:06,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11516b59 >2014-01-30 04:22:07,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 11516b59 >2014-01-30 04:22:07,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 161646c0 >2014-01-30 04:22:07,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f87ffb1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@982caa17}, log id: 161646c0 >2014-01-30 04:22:11,044 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:22:12,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15b2252c >2014-01-30 04:22:12,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 15b2252c >2014-01-30 04:22:12,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e1ecb57 >2014-01-30 04:22:13,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9206ead2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5e53ca7}, log id: 1e1ecb57 >2014-01-30 04:22:16,057 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:22:18,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35ac9917 >2014-01-30 04:22:18,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 35ac9917 >2014-01-30 04:22:18,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c374d49 >2014-01-30 04:22:19,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11ef99db, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb3a3c7b}, log id: c374d49 >2014-01-30 04:22:21,073 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:22:24,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e9098e5 >2014-01-30 04:22:24,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: e9098e5 >2014-01-30 04:22:24,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6161bf68 >2014-01-30 04:22:24,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16808ffa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9512dcc6}, log id: 6161bf68 >2014-01-30 04:22:26,086 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:22:26,452 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-90) [c894cd9] No up server in cluster >2014-01-30 04:22:26,452 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-90) [c894cd9] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:22:26,456 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-90) [c894cd9] No up server in cluster >2014-01-30 04:22:26,456 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-90) [c894cd9] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:22:26,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 3ab4d569 >2014-01-30 04:22:26,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 3ab4d569 >2014-01-30 04:22:29,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3619525e >2014-01-30 04:22:30,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3619525e >2014-01-30 04:22:30,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e50a9b >2014-01-30 04:22:30,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35926dda, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47976484}, log id: 5e50a9b >2014-01-30 04:22:31,102 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:22:35,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26e1e0e2 >2014-01-30 04:22:36,117 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:22:36,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 26e1e0e2 >2014-01-30 04:22:36,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ebbf89d >2014-01-30 04:22:36,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1f2bb5f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5255f578}, log id: ebbf89d >2014-01-30 04:22:41,134 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:22:41,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7bd7a72c >2014-01-30 04:22:42,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7bd7a72c >2014-01-30 04:22:42,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 399b6e92 >2014-01-30 04:22:42,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5953535f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14e227da}, log id: 399b6e92 >2014-01-30 04:22:46,156 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:22:47,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a07e23 >2014-01-30 04:22:47,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1a07e23 >2014-01-30 04:22:47,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46d76197 >2014-01-30 04:22:48,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23201ad5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5c953ee}, log id: 46d76197 >2014-01-30 04:22:51,178 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:22:53,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2aab666e >2014-01-30 04:22:53,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2aab666e >2014-01-30 04:22:53,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a0808fa >2014-01-30 04:22:53,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e08ae1f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b19a538}, log id: 3a0808fa >2014-01-30 04:22:56,201 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:22:58,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 671ed6f7 >2014-01-30 04:22:59,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 671ed6f7 >2014-01-30 04:22:59,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6da1d036 >2014-01-30 04:22:59,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@795de8d9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b528e29f}, log id: 6da1d036 >2014-01-30 04:23:01,223 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:23:04,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 47f18624 >2014-01-30 04:23:05,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 47f18624 >2014-01-30 04:23:05,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b2227f5 >2014-01-30 04:23:05,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba455b01, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@333ed0c7}, log id: 7b2227f5 >2014-01-30 04:23:06,246 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:23:09,548 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] START, GetHardwareInfoVDSCommand(HostName = 10.70.37.216, HostId = 93a4885f-f9f4-4fab-9d15-8e1904d19a99, vds=Host[10.70.37.216]), log id: 6c1117e2 >2014-01-30 04:23:09,646 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-8) [28855a44] FINISH, GetHardwareInfoVDSCommand, log id: 6c1117e2 >2014-01-30 04:23:09,687 INFO [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-8) [3763c200] Running command: SetNonOperationalVdsCommand internal: true. Entities affected : ID: 93a4885f-f9f4-4fab-9d15-8e1904d19a99 Type: VDS >2014-01-30 04:23:09,690 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-8) [3763c200] START, SetVdsStatusVDSCommand(HostName = 10.70.37.216, HostId = 93a4885f-f9f4-4fab-9d15-8e1904d19a99, status=NonOperational, nonOperationalReason=NETWORK_UNREACHABLE), log id: 4596959a >2014-01-30 04:23:09,695 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-8) [3763c200] FINISH, SetVdsStatusVDSCommand, log id: 4596959a >2014-01-30 04:23:09,700 ERROR [org.ovirt.engine.core.bll.SetNonOperationalVdsCommand] (DefaultQuartzScheduler_Worker-8) [3763c200] Host 10.70.37.216 is set to Non-Operational, it is missing the following networks: ovirtmgmt >2014-01-30 04:23:09,713 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) [3763c200] Correlation ID: 3763c200, Job ID: 829c0ccc-c70e-4cfd-8522-5744ca5dd5b2, Call Stack: null, Custom Event ID: -1, Message: Host 10.70.37.216 does not comply with the cluster test_1 networks, the following networks are missing on host: 'ovirtmgmt' >2014-01-30 04:23:09,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [3763c200] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = 93a4885f-f9f4-4fab-9d15-8e1904d19a99), log id: 622bf53c >2014-01-30 04:23:10,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [3763c200] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 622bf53c >2014-01-30 04:23:10,231 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-8) [3763c200] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to NonOperational for host 10.70.37.216. >2014-01-30 04:23:10,251 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 93a4885f-f9f4-4fab-9d15-8e1904d19a99 Type: VDS >2014-01-30 04:23:10,253 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-8) [70a1c224] Host 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216 is already in NonOperational status. SetNonOperationalVds command is skipped. >2014-01-30 04:23:10,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16477a6f >2014-01-30 04:23:11,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 16477a6f >2014-01-30 04:23:11,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 747de430 >2014-01-30 04:23:11,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9af722b2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9ced406}, log id: 747de430 >2014-01-30 04:23:16,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 470052ed >2014-01-30 04:23:16,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 470052ed >2014-01-30 04:23:16,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 574ceb51 >2014-01-30 04:23:17,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92b07973, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c056d814}, log id: 574ceb51 >2014-01-30 04:23:22,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e9abdf8 >2014-01-30 04:23:22,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4e9abdf8 >2014-01-30 04:23:22,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ed294f8 >2014-01-30 04:23:23,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39462e77, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37de24e8}, log id: 6ed294f8 >2014-01-30 04:23:27,007 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-10) [641a6d1] No up server in cluster >2014-01-30 04:23:27,007 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-10) [641a6d1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:23:27,009 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-10) [641a6d1] No up server in cluster >2014-01-30 04:23:27,009 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-10) [641a6d1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:23:27,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44672c85 >2014-01-30 04:23:27,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 44672c85 >2014-01-30 04:23:28,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 107479cd >2014-01-30 04:23:28,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 107479cd >2014-01-30 04:23:28,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18cb1ece >2014-01-30 04:23:28,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39513488, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33748243}, log id: 18cb1ece >2014-01-30 04:23:29,699 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (pool-5-thread-43) [46ea8250] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 93a4885f-f9f4-4fab-9d15-8e1904d19a99 Type: VDS >2014-01-30 04:23:29,703 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-43) [46ea8250] START, SetVdsStatusVDSCommand(HostName = 10.70.37.216, HostId = 93a4885f-f9f4-4fab-9d15-8e1904d19a99, status=PreparingForMaintenance, nonOperationalReason=NONE), log id: 19309d03 >2014-01-30 04:23:29,708 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-43) [46ea8250] FINISH, SetVdsStatusVDSCommand, log id: 19309d03 >2014-01-30 04:23:29,729 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (pool-5-thread-43) [46ea8250] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 93a4885f-f9f4-4fab-9d15-8e1904d19a99 Type: VDS >2014-01-30 04:23:29,734 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-43) [46ea8250] Correlation ID: 46ea8250, Job ID: d16d1a26-36e1-47dc-9159-fffaf9d4d426, Call Stack: null, Custom Event ID: -1, Message: Host 10.70.37.216 was switched to Maintenance mode by admin@internal. >2014-01-30 04:23:31,440 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-19) [7a87389a] Updated vds status from Preparing for Maintenance to Maintenance in database, vds = 93a4885f-f9f4-4fab-9d15-8e1904d19a99 : 10.70.37.216 >2014-01-30 04:23:31,455 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-5-thread-37) Clearing cache of pool: 5849b030-626e-47cb-ad90-3ce782d831b3 for problematic entities of VDS: 10.70.37.216. >2014-01-30 04:23:33,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4601d3ec >2014-01-30 04:23:34,191 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-10) [634bdbd8] Lock Acquired to object EngineLock [exclusiveLocks= key: 93a4885f-f9f4-4fab-9d15-8e1904d19a99 value: VDS >, sharedLocks= ] >2014-01-30 04:23:34,202 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-5-thread-37) [634bdbd8] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 93a4885f-f9f4-4fab-9d15-8e1904d19a99 Type: VDS >2014-01-30 04:23:34,223 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-37) [634bdbd8] START, RemoveVdsVDSCommand( HostId = 93a4885f-f9f4-4fab-9d15-8e1904d19a99), log id: 7b4348dc >2014-01-30 04:23:34,223 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-5-thread-37) [634bdbd8] vdsManager::disposing >2014-01-30 04:23:34,224 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-37) [634bdbd8] FINISH, RemoveVdsVDSCommand, log id: 7b4348dc >2014-01-30 04:23:34,226 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-37) [634bdbd8] Correlation ID: 634bdbd8, Call Stack: null, Custom Event ID: -1, Message: Host 10.70.37.216 was removed by admin@internal. >2014-01-30 04:23:34,227 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-5-thread-37) [634bdbd8] Lock freed to object EngineLock [exclusiveLocks= key: 93a4885f-f9f4-4fab-9d15-8e1904d19a99 value: VDS >, sharedLocks= ] >2014-01-30 04:23:34,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4601d3ec >2014-01-30 04:23:34,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71825b8f >2014-01-30 04:23:34,507 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-9) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:23:34,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@368eadb1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28c40a54}, log id: 71825b8f >2014-01-30 04:23:39,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65ee618f >2014-01-30 04:23:40,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 65ee618f >2014-01-30 04:23:40,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67d8ab34 >2014-01-30 04:23:40,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f2e7f22, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f8d664e}, log id: 67d8ab34 >2014-01-30 04:23:45,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6069dd83 >2014-01-30 04:23:46,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6069dd83 >2014-01-30 04:23:46,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 772959b6 >2014-01-30 04:23:46,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2dd4169, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5372ed02}, log id: 772959b6 >2014-01-30 04:23:51,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 488d3c64 >2014-01-30 04:23:51,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 488d3c64 >2014-01-30 04:23:51,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 462f980e >2014-01-30 04:23:52,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74e7ba21, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18f53785}, log id: 462f980e >2014-01-30 04:23:57,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 75fc228a >2014-01-30 04:23:57,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 75fc228a >2014-01-30 04:23:57,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d8e6e7c >2014-01-30 04:23:57,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abbe7389, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@506f33f6}, log id: 1d8e6e7c >2014-01-30 04:24:02,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 490d2800 >2014-01-30 04:24:03,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 490d2800 >2014-01-30 04:24:03,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2018cb87 >2014-01-30 04:24:03,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c1726c6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe8c29d}, log id: 2018cb87 >2014-01-30 04:24:06,325 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-4) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:24:06,503 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-8) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:24:08,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2fd572ee >2014-01-30 04:24:09,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2fd572ee >2014-01-30 04:24:09,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4212f063 >2014-01-30 04:24:09,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@682723c7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@139418c9}, log id: 4212f063 >2014-01-30 04:24:14,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64892bd8 >2014-01-30 04:24:15,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 64892bd8 >2014-01-30 04:24:15,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 34a786b0 >2014-01-30 04:24:15,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@479f7de2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fbd39398}, log id: 34a786b0 >2014-01-30 04:24:20,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32be7a1c >2014-01-30 04:24:20,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 32be7a1c >2014-01-30 04:24:20,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 999cb3e >2014-01-30 04:24:21,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0859a46, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c0dbbf1}, log id: 999cb3e >2014-01-30 04:24:26,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b7984a3 >2014-01-30 04:24:26,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1b7984a3 >2014-01-30 04:24:26,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2847761e >2014-01-30 04:24:26,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76c5b010, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a85f195}, log id: 2847761e >2014-01-30 04:24:27,554 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] No up server in cluster >2014-01-30 04:24:27,554 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:24:27,558 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] No up server in cluster >2014-01-30 04:24:27,558 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:24:27,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 45b71ca3 >2014-01-30 04:24:28,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 45b71ca3 >2014-01-30 04:24:29,289 INFO [org.ovirt.engine.core.bll.AddVdsGroupCommand] (ajp-/127.0.0.1:8702-6) [4ea4fad5] Running command: AddVdsGroupCommand internal: false. Entities affected : ID: 5849b030-626e-47cb-ad90-3ce782d831b3 Type: StoragePool >2014-01-30 04:24:29,307 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) [4ea4fad5] Correlation ID: 4ea4fad5, Call Stack: null, Custom Event ID: -1, Message: Host cluster test_3 was added by admin@internal >2014-01-30 04:24:29,326 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-5-thread-43) [1db76465] Start running CanDoAction for command number 1/2 (Command type: AddVds) >2014-01-30 04:24:29,327 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-5-thread-37) [73203220] Start running CanDoAction for command number 2/2 (Command type: AddVds) >2014-01-30 04:24:29,612 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-5-thread-43) [1db76465] Finish handling CanDoAction for command number 1/2 (Command type: AddVds) >2014-01-30 04:24:29,641 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-5-thread-37) [73203220] Finish handling CanDoAction for command number 2/2 (Command type: AddVds) >2014-01-30 04:24:29,664 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (pool-5-thread-37) [1db76465] Running command: AddVdsCommand internal: false. Entities affected : ID: 0d368adf-557a-4706-9b3a-f6559a752a3f Type: VdsGroups >2014-01-30 04:24:29,686 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (pool-5-thread-37) [2eb73728] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: e6c3a069-c89e-4562-b99b-4981ac1874f5 Type: VDS >2014-01-30 04:24:29,694 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (pool-5-thread-37) [2eb73728] Lock freed to object EngineLock [exclusiveLocks= key: 5849b030-626e-47cb-ad90-3ce782d831b3 value: REGISTER_VDS >, sharedLocks= ] >2014-01-30 04:24:29,694 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (pool-5-thread-37) [2eb73728] Cannot get vdsManager for vdsid=e6c3a069-c89e-4562-b99b-4981ac1874f5 >2014-01-30 04:24:29,697 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-37) [2eb73728] START, RemoveVdsVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: d70b092 >2014-01-30 04:24:29,697 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (pool-5-thread-37) [2eb73728] Cannot get vdsManager for vdsid=e6c3a069-c89e-4562-b99b-4981ac1874f5 >2014-01-30 04:24:29,697 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-37) [2eb73728] FINISH, RemoveVdsVDSCommand, log id: d70b092 >2014-01-30 04:24:29,698 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (pool-5-thread-37) [2eb73728] Cannot get vdsManager for vdsid=e6c3a069-c89e-4562-b99b-4981ac1874f5 >2014-01-30 04:24:29,699 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (pool-5-thread-37) [2eb73728] START, AddVdsVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 6e27e296 >2014-01-30 04:24:29,699 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (pool-5-thread-37) [2eb73728] AddVds - entered , starting logic to add VDS e6c3a069-c89e-4562-b99b-4981ac1874f5 >2014-01-30 04:24:29,701 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (pool-5-thread-37) [2eb73728] AddVds - VDS e6c3a069-c89e-4562-b99b-4981ac1874f5 was added, will try to add it to the resource manager >2014-01-30 04:24:29,701 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-5-thread-37) [2eb73728] Entered VdsManager constructor >2014-01-30 04:24:29,714 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-5-thread-37) [2eb73728] Initialize vdsBroker (10.70.37.216,54,321) >2014-01-30 04:24:29,716 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (pool-5-thread-37) [2eb73728] VDS e6c3a069-c89e-4562-b99b-4981ac1874f5 was added to the Resource Manager >2014-01-30 04:24:29,716 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (pool-5-thread-37) [2eb73728] FINISH, AddVdsVDSCommand, log id: 6e27e296 >2014-01-30 04:24:29,729 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-43) [6437d7ed] Lock Acquired to object EngineLock [exclusiveLocks= key: e6c3a069-c89e-4562-b99b-4981ac1874f5 value: VDS >, sharedLocks= ] >2014-01-30 04:24:29,730 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-37) [2eb73728] Correlation ID: 1db76465, Job ID: 9c396bec-9498-4a86-9d70-3c03fe70fbc8, Call Stack: null, Custom Event ID: -1, Message: Host 10.70.37.216 was added by admin@internal. >2014-01-30 04:24:29,736 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-43) [6437d7ed] Running command: InstallVdsCommand internal: true. Entities affected : ID: e6c3a069-c89e-4562-b99b-4981ac1874f5 Type: VDS >2014-01-30 04:24:29,736 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-43) [6437d7ed] Before Installation host e6c3a069-c89e-4562-b99b-4981ac1874f5, 10.70.37.216 >2014-01-30 04:24:29,738 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-43) [6437d7ed] START, SetVdsStatusVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5, status=Installing, nonOperationalReason=NONE), log id: 3bcabf33 >2014-01-30 04:24:29,742 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-43) [6437d7ed] FINISH, SetVdsStatusVDSCommand, log id: 3bcabf33 >2014-01-30 04:24:29,757 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (pool-5-thread-37) [73203220] Running command: AddVdsCommand internal: false. Entities affected : ID: 0d368adf-557a-4706-9b3a-f6559a752a3f Type: VdsGroups >2014-01-30 04:24:29,778 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (pool-5-thread-37) [47aa0a07] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: a4b2715f-4e23-4968-84bd-45a2015d690a Type: VDS >2014-01-30 04:24:29,783 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (pool-5-thread-37) [47aa0a07] Lock freed to object EngineLock [exclusiveLocks= key: 5849b030-626e-47cb-ad90-3ce782d831b3 value: REGISTER_VDS >, sharedLocks= ] >2014-01-30 04:24:29,783 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (pool-5-thread-37) [47aa0a07] Cannot get vdsManager for vdsid=a4b2715f-4e23-4968-84bd-45a2015d690a >2014-01-30 04:24:29,784 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-37) [47aa0a07] START, RemoveVdsVDSCommand(HostName = host1, HostId = a4b2715f-4e23-4968-84bd-45a2015d690a), log id: ef7ef12 >2014-01-30 04:24:29,785 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (pool-5-thread-37) [47aa0a07] Cannot get vdsManager for vdsid=a4b2715f-4e23-4968-84bd-45a2015d690a >2014-01-30 04:24:29,785 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-37) [47aa0a07] FINISH, RemoveVdsVDSCommand, log id: ef7ef12 >2014-01-30 04:24:29,785 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (pool-5-thread-37) [47aa0a07] Cannot get vdsManager for vdsid=a4b2715f-4e23-4968-84bd-45a2015d690a >2014-01-30 04:24:29,786 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (pool-5-thread-37) [47aa0a07] START, AddVdsVDSCommand(HostName = host1, HostId = a4b2715f-4e23-4968-84bd-45a2015d690a), log id: 1038088b >2014-01-30 04:24:29,786 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (pool-5-thread-37) [47aa0a07] AddVds - entered , starting logic to add VDS a4b2715f-4e23-4968-84bd-45a2015d690a >2014-01-30 04:24:29,786 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (pool-5-thread-37) [47aa0a07] AddVds - VDS a4b2715f-4e23-4968-84bd-45a2015d690a was added, will try to add it to the resource manager >2014-01-30 04:24:29,787 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-5-thread-37) [47aa0a07] Entered VdsManager constructor >2014-01-30 04:24:29,795 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-5-thread-37) [47aa0a07] Initialize vdsBroker (host1,54,321) >2014-01-30 04:24:29,797 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (pool-5-thread-37) [47aa0a07] VDS a4b2715f-4e23-4968-84bd-45a2015d690a was added to the Resource Manager >2014-01-30 04:24:29,797 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (pool-5-thread-37) [47aa0a07] FINISH, AddVdsVDSCommand, log id: 1038088b >2014-01-30 04:24:29,809 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-47) [28ae08a7] Lock Acquired to object EngineLock [exclusiveLocks= key: a4b2715f-4e23-4968-84bd-45a2015d690a value: VDS >, sharedLocks= ] >2014-01-30 04:24:29,810 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-37) [47aa0a07] Correlation ID: 73203220, Job ID: 4370d371-6bef-4fb6-be46-d40f8e96e9e6, Call Stack: null, Custom Event ID: -1, Message: Host host1 was added by admin@internal. >2014-01-30 04:24:29,818 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-47) [28ae08a7] Running command: InstallVdsCommand internal: true. Entities affected : ID: a4b2715f-4e23-4968-84bd-45a2015d690a Type: VDS >2014-01-30 04:24:29,818 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-47) [28ae08a7] Before Installation host a4b2715f-4e23-4968-84bd-45a2015d690a, host1 >2014-01-30 04:24:29,821 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-47) [28ae08a7] START, SetVdsStatusVDSCommand(HostName = host1, HostId = a4b2715f-4e23-4968-84bd-45a2015d690a, status=Installing, nonOperationalReason=NONE), log id: 584969b8 >2014-01-30 04:24:29,824 INFO [org.ovirt.engine.core.bll.InstallerMessages] (pool-5-thread-43) [6437d7ed] Installation 10.70.37.216: Connected to host 10.70.37.216 with SSH key fingerprint: 73:1e:02:2b:dc:f7:e9:fd:e5:27:d1:8d:7d:77:93:2b >2014-01-30 04:24:29,825 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-47) [28ae08a7] FINISH, SetVdsStatusVDSCommand, log id: 584969b8 >2014-01-30 04:24:29,831 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-43) [6437d7ed] Correlation ID: 6437d7ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.216. Connected to host 10.70.37.216 with SSH key fingerprint: 73:1e:02:2b:dc:f7:e9:fd:e5:27:d1:8d:7d:77:93:2b. >2014-01-30 04:24:29,855 INFO [org.ovirt.engine.core.bll.VdsDeploy] (pool-5-thread-43) [6437d7ed] Installation of 10.70.37.216. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-01-30 04:24:29,865 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-5-thread-43) SSH execute root@10.70.37.216 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-01-30 04:24:29,903 INFO [org.ovirt.engine.core.bll.InstallerMessages] (pool-5-thread-47) [28ae08a7] Installation host1: Connected to host host1 with SSH key fingerprint: a5:c8:7c:b7:40:4f:92:45:9b:86:04:47:25:44:ed:3f >2014-01-30 04:24:29,909 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-47) [28ae08a7] Correlation ID: 28ae08a7, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Connected to host host1 with SSH key fingerprint: a5:c8:7c:b7:40:4f:92:45:9b:86:04:47:25:44:ed:3f. >2014-01-30 04:24:29,932 INFO [org.ovirt.engine.core.bll.VdsDeploy] (pool-5-thread-47) [28ae08a7] Installation of host1. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-01-30 04:24:29,933 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-5-thread-47) SSH execute root@host1 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-01-30 04:24:30,547 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Initializing >2014-01-30 04:24:30,553 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28ae08a7, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Initializing. >2014-01-30 04:24:30,574 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Environment setup >2014-01-30 04:24:30,581 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28ae08a7, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Environment setup. >2014-01-30 04:24:30,591 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Environment packages setup >2014-01-30 04:24:30,599 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28ae08a7, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Environment packages setup. >2014-01-30 04:24:30,719 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.216: Stage: Initializing >2014-01-30 04:24:30,725 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6437d7ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.216. Stage: Initializing. >2014-01-30 04:24:30,748 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.216: Stage: Environment setup >2014-01-30 04:24:30,754 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6437d7ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.216. Stage: Environment setup. >2014-01-30 04:24:30,776 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.216: Stage: Environment packages setup >2014-01-30 04:24:30,784 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6437d7ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.216. Stage: Environment packages setup. >2014-01-30 04:24:31,317 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-5) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:24:31,452 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-9) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:24:32,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3db53e15 >2014-01-30 04:24:32,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3db53e15 >2014-01-30 04:24:32,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 641b883d >2014-01-30 04:24:32,719 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-32) [18099453] Initializing Host: 10.70.37.216 >2014-01-30 04:24:32,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3ccf611, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cf14c15}, log id: 641b883d >2014-01-30 04:24:32,800 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-97) [717bad08] Initializing Host: host1 >2014-01-30 04:24:37,144 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-10) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:24:37,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 784fdcd5 >2014-01-30 04:24:38,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 784fdcd5 >2014-01-30 04:24:38,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5be3b387 >2014-01-30 04:24:38,298 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-3) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:24:38,396 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-11) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:24:38,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@324982e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de1db05b}, log id: 5be3b387 >2014-01-30 04:24:43,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a74ceee >2014-01-30 04:24:44,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1a74ceee >2014-01-30 04:24:44,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40c333b5 >2014-01-30 04:24:44,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3712eb6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b2df4b6}, log id: 40c333b5 >2014-01-30 04:24:47,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 67820ab0 >2014-01-30 04:24:47,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7e04677a, log id: 67820ab0 >2014-01-30 04:24:47,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 5325bb38 >2014-01-30 04:24:47,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@47ce4c55, log id: 5325bb38 >2014-01-30 04:24:49,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c25a179 >2014-01-30 04:24:49,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7c25a179 >2014-01-30 04:24:49,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33f386e0 >2014-01-30 04:24:50,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@774b3d9c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70051db0}, log id: 33f386e0 >2014-01-30 04:24:50,125 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.216: Stage: Programs detection >2014-01-30 04:24:50,129 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6437d7ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.216. Stage: Programs detection. >2014-01-30 04:24:50,129 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.216: Stage: Environment customization >2014-01-30 04:24:50,133 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6437d7ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.216. Stage: Environment customization. >2014-01-30 04:24:50,170 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.216: Logs at host located at: '/tmp/ovirt-host-deploy-20140130042429.log' >2014-01-30 04:24:50,174 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6437d7ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.216. Logs at host located at: '/tmp/ovirt-host-deploy-20140130042429.log'. >2014-01-30 04:24:50,210 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.70.37.216 reports unique id 065D83EF-D757-5A47-0FAB-BAF9CDEF5E5D >2014-01-30 04:24:50,227 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 065D83EF-D757-5A47-0FAB-BAF9CDEF5E5D to Host 10.70.37.216 >2014-01-30 04:24:50,306 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.216: Stage: Setup validation >2014-01-30 04:24:50,315 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6437d7ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.216. Stage: Setup validation. >2014-01-30 04:24:50,320 WARN [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.216: Cannot validate host name settings, reason: cannot resolve own name 'rhs.2' >2014-01-30 04:24:50,328 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6437d7ed, Call Stack: null, Custom Event ID: -1, Message: Host 10.70.37.216 installation in progress . Cannot validate host name settings, reason: cannot resolve own name 'rhs.2'. >2014-01-30 04:24:50,357 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Programs detection >2014-01-30 04:24:50,366 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28ae08a7, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Programs detection. >2014-01-30 04:24:50,366 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Environment customization >2014-01-30 04:24:50,374 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28ae08a7, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Environment customization. >2014-01-30 04:24:50,409 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Logs at host located at: '/tmp/ovirt-host-deploy-20140130042430.log' >2014-01-30 04:24:50,416 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28ae08a7, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Logs at host located at: '/tmp/ovirt-host-deploy-20140130042430.log'. >2014-01-30 04:24:50,454 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host host1 reports unique id 06DBBCA2-4B43-5948-9A88-7BE15E391E01 >2014-01-30 04:24:50,474 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 06DBBCA2-4B43-5948-9A88-7BE15E391E01 to Host host1 >2014-01-30 04:24:50,493 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.216: Stage: Transaction setup >2014-01-30 04:24:50,501 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6437d7ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.216. Stage: Transaction setup. >2014-01-30 04:24:50,529 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.216: Stage: Misc configuration >2014-01-30 04:24:50,536 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6437d7ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.216. Stage: Misc configuration. >2014-01-30 04:24:50,536 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.216: Stage: Package installation >2014-01-30 04:24:50,543 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6437d7ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.216. Stage: Package installation. >2014-01-30 04:24:50,573 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Setup validation >2014-01-30 04:24:50,581 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28ae08a7, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Setup validation. >2014-01-30 04:24:51,002 WARN [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Cannot validate host name settings, reason: cannot resolve own name 'rhs.1' >2014-01-30 04:24:51,011 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28ae08a7, Call Stack: null, Custom Event ID: -1, Message: Host host1 installation in progress . Cannot validate host name settings, reason: cannot resolve own name 'rhs.1'. >2014-01-30 04:24:51,182 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Transaction setup >2014-01-30 04:24:51,190 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28ae08a7, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Transaction setup. >2014-01-30 04:24:51,216 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Misc configuration >2014-01-30 04:24:51,224 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28ae08a7, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Misc configuration. >2014-01-30 04:24:51,224 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Package installation >2014-01-30 04:24:51,232 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28ae08a7, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Package installation. >2014-01-30 04:24:52,638 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.216: Stage: Misc configuration >2014-01-30 04:24:52,646 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6437d7ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.216. Stage: Misc configuration. >2014-01-30 04:24:52,667 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.216: Setting time >2014-01-30 04:24:52,674 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6437d7ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.216. Setting time. >2014-01-30 04:24:53,350 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Misc configuration >2014-01-30 04:24:53,360 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28ae08a7, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Misc configuration. >2014-01-30 04:24:53,369 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Setting time >2014-01-30 04:24:53,378 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28ae08a7, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Setting time. >2014-01-30 04:24:55,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 600ba7fa >2014-01-30 04:24:55,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 600ba7fa >2014-01-30 04:24:55,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41f2fb65 >2014-01-30 04:24:55,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f68c5422, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a007be58}, log id: 41f2fb65 >2014-01-30 04:24:55,799 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Enrolling certificate >2014-01-30 04:24:55,804 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28ae08a7, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Enrolling certificate. >2014-01-30 04:24:56,778 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.216: Enrolling certificate >2014-01-30 04:24:56,786 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6437d7ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.216. Enrolling certificate. >2014-01-30 04:24:56,884 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Transaction commit >2014-01-30 04:24:56,892 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28ae08a7, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Transaction commit. >2014-01-30 04:24:56,949 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Closing up >2014-01-30 04:24:56,956 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28ae08a7, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Closing up. >2014-01-30 04:24:56,956 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Starting gluster >2014-01-30 04:24:56,961 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28ae08a7, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Starting gluster. >2014-01-30 04:24:57,870 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.216: Stage: Transaction commit >2014-01-30 04:24:57,877 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6437d7ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.216. Stage: Transaction commit. >2014-01-30 04:24:57,936 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.216: Stage: Closing up >2014-01-30 04:24:57,941 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6437d7ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.216. Stage: Closing up. >2014-01-30 04:24:57,942 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.216: Starting gluster >2014-01-30 04:24:57,948 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6437d7ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.216. Starting gluster. >2014-01-30 04:25:00,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 656202ee >2014-01-30 04:25:01,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 656202ee >2014-01-30 04:25:01,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1da5551d >2014-01-30 04:25:01,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@691f655, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae60ad6}, log id: 1da5551d >2014-01-30 04:25:03,631 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Starting vdsm >2014-01-30 04:25:03,638 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28ae08a7, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Starting vdsm. >2014-01-30 04:25:04,408 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.216: Starting vdsm >2014-01-30 04:25:04,414 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6437d7ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.216. Starting vdsm. >2014-01-30 04:25:06,236 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Pre-termination >2014-01-30 04:25:06,243 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28ae08a7, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Pre-termination. >2014-01-30 04:25:06,274 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140130042506-host1-28ae08a7.log' >2014-01-30 04:25:06,280 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28ae08a7, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140130042506-host1-28ae08a7.log'. >2014-01-30 04:25:06,547 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Termination >2014-01-30 04:25:06,555 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 28ae08a7, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Termination. >2014-01-30 04:25:06,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25a3cc7f >2014-01-30 04:25:06,633 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [28ae08a7] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:06,633 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [28ae08a7] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:06,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 25a3cc7f >2014-01-30 04:25:06,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a0f4b07 >2014-01-30 04:25:07,109 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.216: Stage: Pre-termination >2014-01-30 04:25:07,114 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6437d7ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.216. Stage: Pre-termination. >2014-01-30 04:25:07,133 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.216: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140130042507-10.70.37.216-6437d7ed.log' >2014-01-30 04:25:07,135 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [28ae08a7] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:07,135 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [28ae08a7] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:07,138 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6437d7ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.216. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140130042507-10.70.37.216-6437d7ed.log'. >2014-01-30 04:25:07,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb8f70de, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29dc0fe2}, log id: 6a0f4b07 >2014-01-30 04:25:07,417 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.216: Stage: Termination >2014-01-30 04:25:07,424 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 6437d7ed, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.216. Stage: Termination. >2014-01-30 04:25:07,523 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-43) [6437d7ed] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:07,524 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-43) [6437d7ed] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:07,662 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (pool-5-thread-47) [28ae08a7] Engine managed to communicate with VDSM agent on host host1 >2014-01-30 04:25:07,807 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (pool-5-thread-47) [5075e119] Running command: SetupNetworksCommand internal: true. Entities affected : ID: a4b2715f-4e23-4968-84bd-45a2015d690a Type: VDS >2014-01-30 04:25:07,808 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-5-thread-47) [5075e119] START, SetupNetworksVDSCommand(HostName = host1, HostId = a4b2715f-4e23-4968-84bd-45a2015d690a, force=false, checkConnectivity=true, conectivityTimeout=120, > networks=[ovirtmgmt {id=00000000-0000-0000-0000-000000000009, description=Management Network, comment=null, subnet=null, gateway=null, type=null, vlanId=null, stp=false, dataCenterId=5849b030-626e-47cb-ad90-3ce782d831b3, mtu=0, vmNetwork=true, cluster=NetworkCluster {id={clusterId=null, networkId=null}, status=OPERATIONAL, display=false, required=true, migration=false}, providedBy=null, label=null}], > bonds=[], > interfaces=[eth1 {id=48552595-1c4b-4a1a-9049-e9da181f9f43, vdsId=a4b2715f-4e23-4968-84bd-45a2015d690a, macAddress=52:54:00:50:00:cc, networkName=null, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=DHCP, address=10.70.37.59, subnet=255.255.254.0, gateway=null, mtu=1500, bridged=false, speed=100, type=0, networkImplementationDetails=null}, > eth0 {id=fb1d628e-0f72-44ae-bd0f-e07218904d02, vdsId=a4b2715f-4e23-4968-84bd-45a2015d690a, macAddress=52:54:00:85:81:9e, networkName=ovirtmgmt, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=DHCP, address=10.70.37.220, subnet=255.255.254.0, gateway=null, mtu=1500, bridged=false, speed=100, type=0, networkImplementationDetails=null}], > removedNetworks=[], > removedBonds=[]), log id: 7214abc >2014-01-30 04:25:07,808 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-5-thread-47) [5075e119] FINISH, SetupNetworksVDSCommand, log id: 7214abc >2014-01-30 04:25:08,029 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-43) [6437d7ed] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:08,029 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-43) [6437d7ed] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:08,551 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (pool-5-thread-43) [6437d7ed] Engine managed to communicate with VDSM agent on host 10.70.37.216 >2014-01-30 04:25:08,717 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (pool-5-thread-43) [2c5daaa2] Running command: SetupNetworksCommand internal: true. Entities affected : ID: e6c3a069-c89e-4562-b99b-4981ac1874f5 Type: VDS >2014-01-30 04:25:08,719 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-5-thread-43) [2c5daaa2] START, SetupNetworksVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5, force=false, checkConnectivity=true, conectivityTimeout=120, > networks=[ovirtmgmt {id=00000000-0000-0000-0000-000000000009, description=Management Network, comment=null, subnet=null, gateway=null, type=null, vlanId=null, stp=false, dataCenterId=5849b030-626e-47cb-ad90-3ce782d831b3, mtu=0, vmNetwork=true, cluster=NetworkCluster {id={clusterId=null, networkId=null}, status=OPERATIONAL, display=false, required=true, migration=false}, providedBy=null, label=null}], > bonds=[], > interfaces=[eth1 {id=669a9c92-5451-4689-b839-dd1a3e40d658, vdsId=e6c3a069-c89e-4562-b99b-4981ac1874f5, macAddress=52:54:00:f1:6b:70, networkName=ovirtmgmt, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=DHCP, address=10.70.37.216, subnet=255.255.254.0, gateway=null, mtu=1500, bridged=false, speed=100, type=0, networkImplementationDetails=null}, > eth0 {id=87515062-8e44-41b0-84a1-05786d17fbf0, vdsId=e6c3a069-c89e-4562-b99b-4981ac1874f5, macAddress=52:54:00:32:cd:5f, networkName=null, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=DHCP, address=10.70.37.158, subnet=255.255.254.0, gateway=null, mtu=1500, bridged=false, speed=0, type=0, networkImplementationDetails=null}], > removedNetworks=[], > removedBonds=[]), log id: 3339aa53 >2014-01-30 04:25:08,720 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-5-thread-43) [2c5daaa2] FINISH, SetupNetworksVDSCommand, log id: 3339aa53 >2014-01-30 04:25:10,325 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:10,325 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:11,748 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-43) [2c5daaa2] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:11,748 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-43) [2c5daaa2] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:12,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5fc33baa >2014-01-30 04:25:12,327 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:12,328 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:12,364 INFO [org.ovirt.engine.core.bll.network.host.CommitNetworkChangesCommand] (pool-5-thread-43) [6aee4fdf] Running command: CommitNetworkChangesCommand internal: true. Entities affected : ID: e6c3a069-c89e-4562-b99b-4981ac1874f5 Type: VDS >2014-01-30 04:25:12,367 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (pool-5-thread-43) [6aee4fdf] START, SetSafeNetworkConfigVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 66783d81 >2014-01-30 04:25:12,399 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (pool-5-thread-43) [6aee4fdf] FINISH, SetSafeNetworkConfigVDSCommand, log id: 66783d81 >2014-01-30 04:25:12,408 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-43) [6aee4fdf] Correlation ID: 6aee4fdf, Call Stack: null, Custom Event ID: -1, Message: Network changes were saved on host 10.70.37.216 >2014-01-30 04:25:12,410 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-43) [6aee4fdf] START, SetVdsStatusVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5, status=Initializing, nonOperationalReason=NONE), log id: 615fc760 >2014-01-30 04:25:12,415 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-43) [6aee4fdf] FINISH, SetVdsStatusVDSCommand, log id: 615fc760 >2014-01-30 04:25:12,415 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-43) [6aee4fdf] After Installation host 10.70.37.216, VDS >2014-01-30 04:25:12,421 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-43) [6aee4fdf] Correlation ID: 6437d7ed, Job ID: 9c396bec-9498-4a86-9d70-3c03fe70fbc8, Call Stack: null, Custom Event ID: -1, Message: Host 10.70.37.216 installed >2014-01-30 04:25:12,425 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-43) [6aee4fdf] Lock freed to object EngineLock [exclusiveLocks= key: e6c3a069-c89e-4562-b99b-4981ac1874f5 value: VDS >, sharedLocks= ] >2014-01-30 04:25:12,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5fc33baa >2014-01-30 04:25:12,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26a69e79 >2014-01-30 04:25:13,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@643d651d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@356c53eb}, log id: 26a69e79 >2014-01-30 04:25:14,331 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:14,331 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:14,823 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] START, GetHardwareInfoVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5, vds=Host[10.70.37.216]), log id: 617358f >2014-01-30 04:25:14,879 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] FINISH, GetHardwareInfoVDSCommand, log id: 617358f >2014-01-30 04:25:14,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 48b02d73 >2014-01-30 04:25:15,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 48b02d73 >2014-01-30 04:25:15,440 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] START, GetHardwareInfoVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5, vds=Host[10.70.37.216]), log id: 44c8b57d >2014-01-30 04:25:15,456 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] FINISH, GetHardwareInfoVDSCommand, log id: 44c8b57d >2014-01-30 04:25:15,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 4c39fb15 >2014-01-30 04:25:15,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [60a96c83] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 4c39fb15 >2014-01-30 04:25:15,955 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-47) [60a96c83] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host 10.70.37.216. >2014-01-30 04:25:15,967 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-47) [7ff2ed1c] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 5849b030-626e-47cb-ad90-3ce782d831b3 Type: StoragePool >2014-01-30 04:25:15,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHostUUIDVDSCommand] (DefaultQuartzScheduler_Worker-47) [7ff2ed1c] START, GetGlusterHostUUIDVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 187343b5 >2014-01-30 04:25:16,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHostUUIDVDSCommand] (DefaultQuartzScheduler_Worker-47) [7ff2ed1c] FINISH, GetGlusterHostUUIDVDSCommand, return: 72110b4b-b4af-41f9-ba5f-69051d5279d9, log id: 187343b5 >2014-01-30 04:25:16,247 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: e6c3a069-c89e-4562-b99b-4981ac1874f5 Type: VDS >2014-01-30 04:25:16,335 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:16,335 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:18,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 114daccd >2014-01-30 04:25:18,339 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:18,339 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:18,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 114daccd >2014-01-30 04:25:18,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36e838d8 >2014-01-30 04:25:18,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@793937e2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebc86dfd}, log id: 36e838d8 >2014-01-30 04:25:18,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 19c01cd7 >2014-01-30 04:25:19,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 19c01cd7 >2014-01-30 04:25:19,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 614aeb09 >2014-01-30 04:25:19,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 614aeb09 >2014-01-30 04:25:20,342 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:20,342 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:22,346 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:22,347 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:24,350 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:24,351 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:24,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 587c7860 >2014-01-30 04:25:25,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 587c7860 >2014-01-30 04:25:25,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e7548ad >2014-01-30 04:25:25,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28063069, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe6e7575}, log id: 1e7548ad >2014-01-30 04:25:25,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 680d4f42 >2014-01-30 04:25:25,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 680d4f42 >2014-01-30 04:25:26,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 2e932320 >2014-01-30 04:25:26,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e932320 >2014-01-30 04:25:26,354 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:26,355 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:28,134 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-87) [6fd19374] No up server in cluster >2014-01-30 04:25:28,134 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-87) [6fd19374] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:25:28,137 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-87) [6fd19374] No up server in cluster >2014-01-30 04:25:28,137 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-87) [6fd19374] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:25:28,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 289b1a77 >2014-01-30 04:25:28,357 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:28,358 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:28,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 289b1a77 >2014-01-30 04:25:28,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterTasksListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 76f719c8 >2014-01-30 04:25:30,360 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:30,360 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:31,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42baf848 >2014-01-30 04:25:31,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 42baf848 >2014-01-30 04:25:31,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c1d258e >2014-01-30 04:25:32,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a45d3d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6eddcb2b}, log id: 7c1d258e >2014-01-30 04:25:32,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 4448a771 >2014-01-30 04:25:32,363 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:32,364 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:32,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 4448a771 >2014-01-30 04:25:32,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 3a691aee >2014-01-30 04:25:32,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a691aee >2014-01-30 04:25:34,367 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:34,367 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:36,371 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:36,372 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:37,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26a9b59d >2014-01-30 04:25:38,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 26a9b59d >2014-01-30 04:25:38,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d9da536 >2014-01-30 04:25:38,374 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:38,374 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:38,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1834f79b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffcef2e6}, log id: 5d9da536 >2014-01-30 04:25:38,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 36ecb91 >2014-01-30 04:25:39,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 36ecb91 >2014-01-30 04:25:39,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 169ae5f0 >2014-01-30 04:25:39,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 169ae5f0 >2014-01-30 04:25:39,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterTasksListVDSCommand, log id: 76f719c8 >2014-01-30 04:25:39,468 ERROR [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-87) [6fd19374] org.ovirt.engine.core.common.errors.VDSError@5fe953af >2014-01-30 04:25:39,468 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-87) [6fd19374] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: Command execution failed >return code: 2 (Failed with error GlusterVolumeStatusAllFailedException and code 4161) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:43) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:25:40,378 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:40,378 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:42,380 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:42,381 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:44,383 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:44,384 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:44,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20d100d1 >2014-01-30 04:25:44,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 20d100d1 >2014-01-30 04:25:44,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b9be723 >2014-01-30 04:25:45,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f3c9b6b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91e401a5}, log id: 1b9be723 >2014-01-30 04:25:45,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 5bb0fe09 >2014-01-30 04:25:45,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 5bb0fe09 >2014-01-30 04:25:45,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 1e4f8715 >2014-01-30 04:25:45,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e4f8715 >2014-01-30 04:25:46,387 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:46,387 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:48,391 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:48,391 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:50,395 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:50,395 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:50,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 712b48a4 >2014-01-30 04:25:51,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 712b48a4 >2014-01-30 04:25:51,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e279b4 >2014-01-30 04:25:51,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f0900f1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@900f3b48}, log id: 2e279b4 >2014-01-30 04:25:51,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 5e90fb88 >2014-01-30 04:25:52,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 5e90fb88 >2014-01-30 04:25:52,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 690dbeb0 >2014-01-30 04:25:52,398 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:52,398 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:52,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 690dbeb0 >2014-01-30 04:25:54,402 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:54,403 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:56,406 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:56,407 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:57,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6cbb21c5 >2014-01-30 04:25:57,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6cbb21c5 >2014-01-30 04:25:57,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f80f6f9 >2014-01-30 04:25:58,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9950641f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b230711}, log id: 2f80f6f9 >2014-01-30 04:25:58,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 7ec04d64 >2014-01-30 04:25:58,410 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:58,410 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:25:58,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 7ec04d64 >2014-01-30 04:25:58,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 21ebbf1f >2014-01-30 04:25:59,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21ebbf1f >2014-01-30 04:26:00,414 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:00,414 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:02,418 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:02,418 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:03,416 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:03,417 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:04,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c5d96ff >2014-01-30 04:26:04,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7c5d96ff >2014-01-30 04:26:04,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7aeebd1d >2014-01-30 04:26:04,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d7c5d4c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fad34132}, log id: 7aeebd1d >2014-01-30 04:26:04,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 7d2a5947 >2014-01-30 04:26:05,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 7d2a5947 >2014-01-30 04:26:05,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 73d5dd13 >2014-01-30 04:26:05,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:05,420 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:05,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73d5dd13 >2014-01-30 04:26:06,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:06,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:08,423 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:08,423 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:09,422 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:09,422 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:10,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 786bae52 >2014-01-30 04:26:11,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 786bae52 >2014-01-30 04:26:11,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52f30fcd >2014-01-30 04:26:11,426 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:11,426 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:11,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48d829a5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6cfee846}, log id: 52f30fcd >2014-01-30 04:26:11,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 59217f74 >2014-01-30 04:26:11,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 59217f74 >2014-01-30 04:26:11,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 3ab0804c >2014-01-30 04:26:12,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ab0804c >2014-01-30 04:26:12,425 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:12,425 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:14,429 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:14,430 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:15,428 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:15,428 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:17,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d4319c0 >2014-01-30 04:26:17,432 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:17,432 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:17,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7d4319c0 >2014-01-30 04:26:17,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3908f2b4 >2014-01-30 04:26:17,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7c0aa4b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cdbd0410}, log id: 3908f2b4 >2014-01-30 04:26:18,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 789509fe >2014-01-30 04:26:18,431 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:18,431 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:18,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 789509fe >2014-01-30 04:26:18,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 774bbec8 >2014-01-30 04:26:18,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 774bbec8 >2014-01-30 04:26:20,435 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:20,435 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:21,433 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:21,433 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:23,437 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:23,437 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:23,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c7cd51f >2014-01-30 04:26:24,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c7cd51f >2014-01-30 04:26:24,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a5ab14c >2014-01-30 04:26:24,436 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:24,436 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:24,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a06e0004, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b98383e}, log id: 6a5ab14c >2014-01-30 04:26:24,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 17423d24 >2014-01-30 04:26:25,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 17423d24 >2014-01-30 04:26:25,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 7557bec1 >2014-01-30 04:26:25,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7557bec1 >2014-01-30 04:26:26,440 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:26,440 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:27,439 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:27,439 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:29,443 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:29,443 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:30,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 240dfc9 >2014-01-30 04:26:30,442 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:30,442 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:30,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 240dfc9 >2014-01-30 04:26:30,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7211b74e >2014-01-30 04:26:31,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebe744d1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0830140}, log id: 7211b74e >2014-01-30 04:26:31,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 20b85a28 >2014-01-30 04:26:31,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 20b85a28 >2014-01-30 04:26:31,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 2e462b47 >2014-01-30 04:26:31,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e462b47 >2014-01-30 04:26:32,445 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:32,446 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:33,444 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:33,444 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:35,448 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:35,448 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:36,447 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:36,447 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:36,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60e97639 >2014-01-30 04:26:37,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 60e97639 >2014-01-30 04:26:37,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53209c72 >2014-01-30 04:26:37,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@525aeb82, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ac87036}, log id: 53209c72 >2014-01-30 04:26:37,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 12257706 >2014-01-30 04:26:38,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 12257706 >2014-01-30 04:26:38,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 246b39d6 >2014-01-30 04:26:38,451 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:38,452 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:38,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 246b39d6 >2014-01-30 04:26:39,450 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:39,450 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:39,477 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2014-01-30 04:26:39,477 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:26:39,480 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2014-01-30 04:26:39,480 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:26:39,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 78e68816 >2014-01-30 04:26:40,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 78e68816 >2014-01-30 04:26:40,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 436d7ead >2014-01-30 04:26:40,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [], log id: 436d7ead >2014-01-30 04:26:41,454 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:41,454 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:42,453 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:42,453 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:43,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48af17f4 >2014-01-30 04:26:44,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 48af17f4 >2014-01-30 04:26:44,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f86965e >2014-01-30 04:26:44,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e9ad688, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88dd7bae}, log id: 3f86965e >2014-01-30 04:26:44,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 4ebccb4e >2014-01-30 04:26:44,457 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:44,457 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:44,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 4ebccb4e >2014-01-30 04:26:44,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 48ad1518 >2014-01-30 04:26:45,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48ad1518 >2014-01-30 04:26:45,456 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:45,456 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:47,460 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:47,460 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:48,459 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:48,459 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:50,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a7488a3 >2014-01-30 04:26:50,462 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:50,462 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:50,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4a7488a3 >2014-01-30 04:26:50,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67d5f79 >2014-01-30 04:26:50,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41a98d3c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e83dfd0d}, log id: 67d5f79 >2014-01-30 04:26:50,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 7ac515ac >2014-01-30 04:26:51,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 7ac515ac >2014-01-30 04:26:51,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 4a8ebf86 >2014-01-30 04:26:51,461 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:51,461 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:51,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a8ebf86 >2014-01-30 04:26:53,465 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:53,465 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:54,463 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:54,463 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:56,467 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:56,467 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:56,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e057858 >2014-01-30 04:26:57,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4e057858 >2014-01-30 04:26:57,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 789d68a8 >2014-01-30 04:26:57,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5328f2a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c584461}, log id: 789d68a8 >2014-01-30 04:26:57,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 2ae1a285 >2014-01-30 04:26:57,466 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:57,466 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:57,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 2ae1a285 >2014-01-30 04:26:57,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 26ab412d >2014-01-30 04:26:58,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26ab412d >2014-01-30 04:26:59,469 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:26:59,470 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:00,468 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:00,468 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:02,472 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:02,472 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:03,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 698d2015 >2014-01-30 04:27:03,470 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:03,470 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:03,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 698d2015 >2014-01-30 04:27:03,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ab1c50f >2014-01-30 04:27:03,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8213ead, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45a069d5}, log id: 3ab1c50f >2014-01-30 04:27:03,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 1d7795c5 >2014-01-30 04:27:04,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 1d7795c5 >2014-01-30 04:27:04,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 3e3586cb >2014-01-30 04:27:04,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e3586cb >2014-01-30 04:27:05,473 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:05,473 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:06,472 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:06,472 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:08,476 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:08,476 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:09,475 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:09,475 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:09,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46ce3155 >2014-01-30 04:27:10,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 46ce3155 >2014-01-30 04:27:10,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1759765 >2014-01-30 04:27:10,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4520be9c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9601edb}, log id: 1759765 >2014-01-30 04:27:10,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 7e6e4f83 >2014-01-30 04:27:10,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 7e6e4f83 >2014-01-30 04:27:10,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: fdda435 >2014-01-30 04:27:11,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fdda435 >2014-01-30 04:27:11,479 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:11,479 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:12,478 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:12,478 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:14,482 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:14,482 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:15,481 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:15,481 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:16,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16293578 >2014-01-30 04:27:16,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 16293578 >2014-01-30 04:27:16,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44bfb5d6 >2014-01-30 04:27:16,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12a60089, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@772e652}, log id: 44bfb5d6 >2014-01-30 04:27:17,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 7834fcf4 >2014-01-30 04:27:17,484 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:17,485 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:17,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 7834fcf4 >2014-01-30 04:27:17,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 56926f0e >2014-01-30 04:27:17,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56926f0e >2014-01-30 04:27:18,483 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:18,483 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:20,487 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:20,487 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:21,486 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:21,486 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:22,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7fe20bbf >2014-01-30 04:27:23,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7fe20bbf >2014-01-30 04:27:23,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3043b2ae >2014-01-30 04:27:23,490 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:23,490 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:23,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3295e52d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f47e22c4}, log id: 3043b2ae >2014-01-30 04:27:23,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 5de2b613 >2014-01-30 04:27:24,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 5de2b613 >2014-01-30 04:27:24,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 5f18b5d >2014-01-30 04:27:24,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f18b5d >2014-01-30 04:27:24,489 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:24,489 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:26,491 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:26,491 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:27,491 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:27,491 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:29,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30d09808 >2014-01-30 04:27:29,495 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:29,495 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:29,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 30d09808 >2014-01-30 04:27:29,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4981c14e >2014-01-30 04:27:30,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a64da0ce, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89f4194f}, log id: 4981c14e >2014-01-30 04:27:30,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 1eba9789 >2014-01-30 04:27:30,494 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:30,494 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:30,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 1eba9789 >2014-01-30 04:27:30,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 1ccf0cf5 >2014-01-30 04:27:30,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ccf0cf5 >2014-01-30 04:27:32,497 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:32,497 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:33,496 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:33,496 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:35,500 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:35,500 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:35,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c21aad2 >2014-01-30 04:27:36,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c21aad2 >2014-01-30 04:27:36,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c4ff0d5 >2014-01-30 04:27:36,499 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:36,499 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:36,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71a79fb0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7a4afeb}, log id: 2c4ff0d5 >2014-01-30 04:27:36,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 20d405cb >2014-01-30 04:27:37,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 20d405cb >2014-01-30 04:27:37,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 2e9dda78 >2014-01-30 04:27:37,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e9dda78 >2014-01-30 04:27:38,502 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:38,502 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:39,501 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:39,501 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:40,310 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) [992a9f] No up server in cluster >2014-01-30 04:27:40,310 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) [992a9f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:27:40,313 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) [992a9f] No up server in cluster >2014-01-30 04:27:40,313 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) [992a9f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:27:40,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 70acbd7b >2014-01-30 04:27:40,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 70acbd7b >2014-01-30 04:27:40,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterTasksListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 449fe55c >2014-01-30 04:27:41,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterTasksListVDSCommand, return: [], log id: 449fe55c >2014-01-30 04:27:41,504 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:41,504 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:42,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7840f8ef >2014-01-30 04:27:42,504 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:42,504 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:42,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7840f8ef >2014-01-30 04:27:42,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 990e52e >2014-01-30 04:27:43,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e9e2d5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c71af4f8}, log id: 990e52e >2014-01-30 04:27:43,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 2a7790c >2014-01-30 04:27:43,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 2a7790c >2014-01-30 04:27:43,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 47cec14d >2014-01-30 04:27:44,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47cec14d >2014-01-30 04:27:44,508 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:44,508 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:45,506 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:45,506 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:47,510 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:47,510 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:48,509 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:48,509 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:49,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d2262de >2014-01-30 04:27:49,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: d2262de >2014-01-30 04:27:49,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54822c10 >2014-01-30 04:27:49,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e97d8c0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0dafd46}, log id: 54822c10 >2014-01-30 04:27:49,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 5dfc6610 >2014-01-30 04:27:50,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 5dfc6610 >2014-01-30 04:27:50,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 73b1cf06 >2014-01-30 04:27:50,513 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:50,513 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:50,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73b1cf06 >2014-01-30 04:27:51,511 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:51,511 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:53,515 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:53,515 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:54,514 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:54,514 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:55,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2bdf7c9 >2014-01-30 04:27:56,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2bdf7c9 >2014-01-30 04:27:56,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13183835 >2014-01-30 04:27:56,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13d6cf9b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31560293}, log id: 13183835 >2014-01-30 04:27:56,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 587a75dd >2014-01-30 04:27:56,518 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:56,519 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:56,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 587a75dd >2014-01-30 04:27:56,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 5e58aed5 >2014-01-30 04:27:57,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e58aed5 >2014-01-30 04:27:57,517 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:57,517 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:59,520 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:27:59,520 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:28:00,519 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:28:00,519 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:28:02,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69700273 >2014-01-30 04:28:02,523 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:28:02,524 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:28:02,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 69700273 >2014-01-30 04:28:02,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 497c7c08 >2014-01-30 04:28:02,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@810716b1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34b79a17}, log id: 497c7c08 >2014-01-30 04:28:02,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: e373899 >2014-01-30 04:28:03,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: e373899 >2014-01-30 04:28:03,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 6eb1cebc >2014-01-30 04:28:03,522 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:28:03,522 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:28:03,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6eb1cebc >2014-01-30 04:28:05,526 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:28:05,526 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:28:06,524 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:28:06,524 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:28:08,528 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:28:08,528 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [5075e119] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:28:08,529 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-5-thread-47) [5075e119] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:28:08,529 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-5-thread-47) [5075e119] Command SetupNetworksVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:28:08,530 ERROR [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (pool-5-thread-47) [5075e119] Command org.ovirt.engine.core.bll.network.host.SetupNetworksCommand throw Vdc Bll exception. With error message VdcBLLException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException (Failed with error ENGINE and code 5001) >2014-01-30 04:28:08,539 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-47) [5075e119] Failed to configure management network: Failed to configure management network on host host1 due to setup networks failure. >2014-01-30 04:28:08,539 ERROR [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-47) [5075e119] Host installation failed for host a4b2715f-4e23-4968-84bd-45a2015d690a, host1.: org.ovirt.engine.core.bll.InstallVdsCommand$VdsInstallException: Failed to configure management network on the host > at org.ovirt.engine.core.bll.InstallVdsCommand.configureManagementNetwork(InstallVdsCommand.java:306) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.installHost(InstallVdsCommand.java:205) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.executeCommand(InstallVdsCommand.java:105) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor84.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:235) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:374) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:218) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.AddVdsCommand$3.run(AddVdsCommand.java:165) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_45] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_45] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_45] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_45] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_45] >Caused by: org.ovirt.engine.core.bll.network.NetworkConfigurator$NetworkConfiguratorException: Failed to configure management network > at org.ovirt.engine.core.bll.network.NetworkConfigurator.configureManagementNetwork(NetworkConfigurator.java:241) [bll.jar:] > at org.ovirt.engine.core.bll.network.NetworkConfigurator.createManagementNetworkIfRequired(NetworkConfigurator.java:69) [bll.jar:] > at org.ovirt.engine.core.bll.InstallVdsCommand.configureManagementNetwork(InstallVdsCommand.java:298) [bll.jar:] > ... 60 more > >2014-01-30 04:28:08,546 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-47) [5075e119] START, SetVdsStatusVDSCommand(HostName = host1, HostId = a4b2715f-4e23-4968-84bd-45a2015d690a, status=NonOperational, nonOperationalReason=NONE), log id: 11df065b >2014-01-30 04:28:08,550 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-47) [5075e119] FINISH, SetVdsStatusVDSCommand, log id: 11df065b >2014-01-30 04:28:08,564 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-47) [5075e119] Correlation ID: 28ae08a7, Job ID: 4370d371-6bef-4fb6-be46-d40f8e96e9e6, Call Stack: null, Custom Event ID: -1, Message: Host host1 installation failed. Failed to configure management network on the host. >2014-01-30 04:28:08,577 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-47) [5075e119] Lock freed to object EngineLock [exclusiveLocks= key: a4b2715f-4e23-4968-84bd-45a2015d690a value: VDS >, sharedLocks= ] >2014-01-30 04:28:08,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29ee0b89 >2014-01-30 04:28:09,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 29ee0b89 >2014-01-30 04:28:09,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11a5e242 >2014-01-30 04:28:09,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5b98b50, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffc9b22d}, log id: 11a5e242 >2014-01-30 04:28:09,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 3e6949a >2014-01-30 04:28:09,528 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:28:09,537 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-87) [6fd19374] Failed to refresh VDS , vds = a4b2715f-4e23-4968-84bd-45a2015d690a : host1, VDS Network Error, continuing. >java.net.NoRouteToHostException: No route to host >2014-01-30 04:28:09,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 3e6949a >2014-01-30 04:28:09,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 17a7cad1 >2014-01-30 04:28:10,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17a7cad1 >2014-01-30 04:28:14,547 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:28:14,553 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-92) [61402a04] Failed to refresh VDS , vds = a4b2715f-4e23-4968-84bd-45a2015d690a : host1, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 04:28:15,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e3a9704 >2014-01-30 04:28:15,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4e3a9704 >2014-01-30 04:28:15,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e7a60d >2014-01-30 04:28:15,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8cb07ea7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab3b7168}, log id: e7a60d >2014-01-30 04:28:16,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 3e30b9ce >2014-01-30 04:28:16,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 3e30b9ce >2014-01-30 04:28:16,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 7ba81838 >2014-01-30 04:28:16,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ba81838 >2014-01-30 04:28:18,546 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:28:18,546 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-21) [3dfe147] Server failed to respond, vds_id = a4b2715f-4e23-4968-84bd-45a2015d690a, vds_name = host1, vm_count = 0, spm_status = None, non-responsive_timeout (seconds) = 60, error = java.net.NoRouteToHostException: No route to host >2014-01-30 04:28:18,557 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-21) [3dfe147] Correlation ID: null, Call Stack: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.NoRouteToHostException: No route to host > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:102) > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:28) > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:532) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:485) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.Refresh(VdsUpdateRunTimeInfo.java:336) > at org.ovirt.engine.core.vdsbroker.VdsManager.OnTimer(VdsManager.java:235) > at sun.reflect.GeneratedMethodAccessor56.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) >Caused by: java.net.NoRouteToHostException: No route to host > at java.net.PlainSocketImpl.socketConnect(Native Method) > at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) > at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) > at java.net.Socket.connect(Socket.java:579) > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) > at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707) > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionManager.java:1361) > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387) > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) > at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397) > at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323) > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) > at com.sun.proxy.$Proxy113.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:225) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Host host1 is non responsive. >2014-01-30 04:28:18,559 INFO [org.ovirt.engine.core.bll.VdsEventListener] (pool-5-thread-47) [3dfe147] ResourceManager::vdsNotResponding entered for Host a4b2715f-4e23-4968-84bd-45a2015d690a, host1 >2014-01-30 04:28:18,589 INFO [org.ovirt.engine.core.bll.SshSoftFencingCommand] (pool-5-thread-47) [1c752009] Running command: SshSoftFencingCommand internal: true. Entities affected : ID: a4b2715f-4e23-4968-84bd-45a2015d690a Type: VDS >2014-01-30 04:28:21,547 ERROR [org.ovirt.engine.core.bll.SshSoftFencingCommand] (pool-5-thread-47) [1c752009] SSH connection to host host1 failed: org.apache.sshd.common.RuntimeSshException: Failed to get the session.: org.apache.sshd.common.RuntimeSshException: Failed to get the session. > at org.apache.sshd.client.future.DefaultConnectFuture.getSession(DefaultConnectFuture.java:43) > at org.ovirt.engine.core.utils.ssh.SSHClient.connect(SSHClient.java:288) [utils.jar:] > at org.ovirt.engine.core.bll.utils.EngineSSHClient.connect(EngineSSHClient.java:59) [bll.jar:] > at org.ovirt.engine.core.bll.SshSoftFencingCommand.executeSshSoftFencingCommand(SshSoftFencingCommand.java:73) [bll.jar:] > at org.ovirt.engine.core.bll.SshSoftFencingCommand.executeCommand(SshSoftFencingCommand.java:43) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor84.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:235) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:374) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:218) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.VdsEventListener$1.run(VdsEventListener.java:134) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_45] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_45] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_45] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_45] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_45] >Caused by: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_45] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:735) [rt.jar:1.7.0_45] > at org.apache.mina.transport.socket.nio.NioSocketConnector.finishConnect(NioSocketConnector.java:224) [mina-core.jar:] > at org.apache.mina.transport.socket.nio.NioSocketConnector.finishConnect(NioSocketConnector.java:46) [mina-core.jar:] > at org.apache.mina.core.polling.AbstractPollingIoConnector.processConnections(AbstractPollingIoConnector.java:439) [mina-core.jar:] > at org.apache.mina.core.polling.AbstractPollingIoConnector.access$700(AbstractPollingIoConnector.java:64) [mina-core.jar:] > at org.apache.mina.core.polling.AbstractPollingIoConnector$Connector.run(AbstractPollingIoConnector.java:508) [mina-core.jar:] > at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:64) [mina-core.jar:] > ... 3 more > >2014-01-30 04:28:21,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42673073 >2014-01-30 04:28:22,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 42673073 >2014-01-30 04:28:22,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e4a9e32 >2014-01-30 04:28:22,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f2b48e3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41675655}, log id: 1e4a9e32 >2014-01-30 04:28:22,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 8020647 >2014-01-30 04:28:23,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 8020647 >2014-01-30 04:28:23,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 2af41f37 >2014-01-30 04:28:23,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2af41f37 >2014-01-30 04:28:23,573 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:28:27,908 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:28:28,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e7db575 >2014-01-30 04:28:28,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4e7db575 >2014-01-30 04:28:28,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e1e1aa8 >2014-01-30 04:28:29,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41a0706b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d12e337}, log id: 5e1e1aa8 >2014-01-30 04:28:29,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 50db5979 >2014-01-30 04:28:29,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 50db5979 >2014-01-30 04:28:29,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 6850fb9b >2014-01-30 04:28:29,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6850fb9b >2014-01-30 04:28:31,531 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:28:34,628 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:28:34,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78b94186 >2014-01-30 04:28:35,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 78b94186 >2014-01-30 04:28:35,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12b57b4c >2014-01-30 04:28:35,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6745cb1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb2b8009}, log id: 12b57b4c >2014-01-30 04:28:35,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 70f0beaf >2014-01-30 04:28:36,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 70f0beaf >2014-01-30 04:28:36,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 40bd41b6 >2014-01-30 04:28:36,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40bd41b6 >2014-01-30 04:28:38,187 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:28:41,119 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-5) [5cab3cac] No up server in cluster >2014-01-30 04:28:41,119 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-5) [5cab3cac] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:28:41,122 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-5) [5cab3cac] No up server in cluster >2014-01-30 04:28:41,123 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-5) [5cab3cac] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:28:41,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 3b3bcfd6 >2014-01-30 04:28:41,348 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-56) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:28:41,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60d83843 >2014-01-30 04:28:41,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 3b3bcfd6 >2014-01-30 04:28:41,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterTasksListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 78722883 >2014-01-30 04:28:41,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 60d83843 >2014-01-30 04:28:41,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3379d8bc >2014-01-30 04:28:41,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterTasksListVDSCommand, return: [], log id: 78722883 >2014-01-30 04:28:42,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87e7bf17, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@778ad9d}, log id: 3379d8bc >2014-01-30 04:28:42,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 1f595f44 >2014-01-30 04:28:42,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 1f595f44 >2014-01-30 04:28:42,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 5c352816 >2014-01-30 04:28:42,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c352816 >2014-01-30 04:28:44,843 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:28:47,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d49e36d >2014-01-30 04:28:48,068 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:28:48,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7d49e36d >2014-01-30 04:28:48,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 63cb9f00 >2014-01-30 04:28:48,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1d7eab, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38679dde}, log id: 63cb9f00 >2014-01-30 04:28:48,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 1527d6e7 >2014-01-30 04:28:49,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 1527d6e7 >2014-01-30 04:28:49,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 10533e25 >2014-01-30 04:28:49,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10533e25 >2014-01-30 04:28:51,499 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:28:54,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 449a0361 >2014-01-30 04:28:54,792 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:28:55,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 449a0361 >2014-01-30 04:28:55,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29b0db6d >2014-01-30 04:28:55,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e383633, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c80c166}, log id: 29b0db6d >2014-01-30 04:28:55,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 62ed07d0 >2014-01-30 04:28:55,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 62ed07d0 >2014-01-30 04:28:55,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 7537f42a >2014-01-30 04:28:56,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7537f42a >2014-01-30 04:28:58,155 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:29:01,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1aa748f7 >2014-01-30 04:29:01,483 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:29:01,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1aa748f7 >2014-01-30 04:29:01,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1bbc5a47 >2014-01-30 04:29:01,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30caa459, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@acc735a0}, log id: 1bbc5a47 >2014-01-30 04:29:01,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 2fea648c >2014-01-30 04:29:02,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 2fea648c >2014-01-30 04:29:02,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 32878f77 >2014-01-30 04:29:02,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32878f77 >2014-01-30 04:29:04,811 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-53) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:29:07,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44a2d206 >2014-01-30 04:29:08,142 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:29:08,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 44a2d206 >2014-01-30 04:29:08,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3027d062 >2014-01-30 04:29:08,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33a3377e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@597da2e5}, log id: 3027d062 >2014-01-30 04:29:08,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 45a8ae79 >2014-01-30 04:29:08,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 45a8ae79 >2014-01-30 04:29:08,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 18be4299 >2014-01-30 04:29:09,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18be4299 >2014-01-30 04:29:11,467 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:29:14,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15876e71 >2014-01-30 04:29:14,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 15876e71 >2014-01-30 04:29:14,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e5ba95 >2014-01-30 04:29:14,795 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:29:15,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@335759ac, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6bd52a27}, log id: e5ba95 >2014-01-30 04:29:15,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 1bea4615 >2014-01-30 04:29:15,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 1bea4615 >2014-01-30 04:29:15,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 7cbcc607 >2014-01-30 04:29:15,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cbcc607 >2014-01-30 04:29:18,123 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:29:20,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d666432 >2014-01-30 04:29:21,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4d666432 >2014-01-30 04:29:21,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4acbcca6 >2014-01-30 04:29:21,451 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:29:21,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e407ed9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7648ac41}, log id: 4acbcca6 >2014-01-30 04:29:21,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 7cd29b48 >2014-01-30 04:29:22,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 7cd29b48 >2014-01-30 04:29:22,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 57d42aef >2014-01-30 04:29:22,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57d42aef >2014-01-30 04:29:24,779 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:29:27,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 451cc8d5 >2014-01-30 04:29:27,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 451cc8d5 >2014-01-30 04:29:27,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24cdd93f >2014-01-30 04:29:28,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16424cbb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7cadc04a}, log id: 24cdd93f >2014-01-30 04:29:28,107 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:29:28,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 1f2dcd8d >2014-01-30 04:29:28,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 1f2dcd8d >2014-01-30 04:29:28,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 9e22530 >2014-01-30 04:29:28,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9e22530 >2014-01-30 04:29:31,435 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:29:33,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29ccc39a >2014-01-30 04:29:34,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 29ccc39a >2014-01-30 04:29:34,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 39c772ef >2014-01-30 04:29:34,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4eae6ee7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9a0272d}, log id: 39c772ef >2014-01-30 04:29:34,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 64663df9 >2014-01-30 04:29:34,763 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:29:35,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 64663df9 >2014-01-30 04:29:35,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 76430254 >2014-01-30 04:29:35,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76430254 >2014-01-30 04:29:38,091 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:29:40,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 774637c8 >2014-01-30 04:29:41,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 774637c8 >2014-01-30 04:29:41,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d53a84c >2014-01-30 04:29:41,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb86d32, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77ec67b2}, log id: 7d53a84c >2014-01-30 04:29:41,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 476cc2a8 >2014-01-30 04:29:41,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:29:41,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 476cc2a8 >2014-01-30 04:29:41,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: d05d438 >2014-01-30 04:29:41,897 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-26) [7a78e8e] No up server in cluster >2014-01-30 04:29:41,897 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-26) [7a78e8e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:29:41,900 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-26) [7a78e8e] No up server in cluster >2014-01-30 04:29:41,901 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-26) [7a78e8e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:29:41,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7cf3d192 >2014-01-30 04:29:42,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d05d438 >2014-01-30 04:29:42,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 7cf3d192 >2014-01-30 04:29:42,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterTasksListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 1e0a6c33 >2014-01-30 04:29:42,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterTasksListVDSCommand, return: [], log id: 1e0a6c33 >2014-01-30 04:29:44,747 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:29:47,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33ae8cad >2014-01-30 04:29:47,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 33ae8cad >2014-01-30 04:29:47,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e8b687c >2014-01-30 04:29:47,581 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-63) [1d6d6076] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 04:29:47,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d961b1fa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@352c79e2}, log id: 5e8b687c >2014-01-30 04:29:47,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 4117a32 >2014-01-30 04:29:47,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 8ffff2c >2014-01-30 04:29:48,075 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-4) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:29:48,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@17bb0951, log id: 4117a32 >2014-01-30 04:29:48,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 7860b102 >2014-01-30 04:29:48,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 8ffff2c >2014-01-30 04:29:48,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 3a783819 >2014-01-30 04:29:48,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3bbeb8da, log id: 7860b102 >2014-01-30 04:29:48,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a783819 >2014-01-30 04:29:51,403 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.NoRouteToHostException: No route to host >2014-01-30 04:29:53,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54323b91 >2014-01-30 04:29:54,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 54323b91 >2014-01-30 04:29:54,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7770f434 >2014-01-30 04:29:54,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b6216ce, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3da17e64}, log id: 7770f434 >2014-01-30 04:29:54,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 422a97b5 >2014-01-30 04:29:54,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 422a97b5 >2014-01-30 04:29:54,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 7ed25489 >2014-01-30 04:29:55,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ed25489 >2014-01-30 04:29:56,420 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:30:00,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 339466b9 >2014-01-30 04:30:00,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 339466b9 >2014-01-30 04:30:00,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fc8f39c >2014-01-30 04:30:00,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8cdf7b5c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29998123}, log id: 3fc8f39c >2014-01-30 04:30:00,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 10e3fc0a >2014-01-30 04:30:01,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 10e3fc0a >2014-01-30 04:30:01,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 634a038c >2014-01-30 04:30:01,441 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:30:01,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 634a038c >2014-01-30 04:30:06,461 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:30:06,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4dc50fb6 >2014-01-30 04:30:07,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4dc50fb6 >2014-01-30 04:30:07,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60f29fdb >2014-01-30 04:30:07,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4781828, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e1f16d3}, log id: 60f29fdb >2014-01-30 04:30:07,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 34242f46 >2014-01-30 04:30:07,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 34242f46 >2014-01-30 04:30:07,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 2392ace1 >2014-01-30 04:30:08,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2392ace1 >2014-01-30 04:30:11,479 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:30:13,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4331f355 >2014-01-30 04:30:13,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4331f355 >2014-01-30 04:30:13,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5269316c >2014-01-30 04:30:14,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca738a40, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7625b41d}, log id: 5269316c >2014-01-30 04:30:14,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 49247de5 >2014-01-30 04:30:14,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 49247de5 >2014-01-30 04:30:14,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 7d0d6388 >2014-01-30 04:30:14,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d0d6388 >2014-01-30 04:30:16,502 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:30:19,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49b7ff58 >2014-01-30 04:30:20,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 49b7ff58 >2014-01-30 04:30:20,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22683995 >2014-01-30 04:30:20,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39d4c3b8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4cedea1}, log id: 22683995 >2014-01-30 04:30:20,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 68ce345b >2014-01-30 04:30:21,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 68ce345b >2014-01-30 04:30:21,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 481e22c >2014-01-30 04:30:21,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 481e22c >2014-01-30 04:30:21,522 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:30:26,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 624741d8 >2014-01-30 04:30:26,545 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:30:26,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 624741d8 >2014-01-30 04:30:26,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5af14c13 >2014-01-30 04:30:27,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa5232f1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1fbe2fe}, log id: 5af14c13 >2014-01-30 04:30:27,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 46e77e25 >2014-01-30 04:30:27,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 46e77e25 >2014-01-30 04:30:27,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 1359e34d >2014-01-30 04:30:27,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1359e34d >2014-01-30 04:30:31,562 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:30:32,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e0bc97d >2014-01-30 04:30:33,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7e0bc97d >2014-01-30 04:30:33,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 506bfd72 >2014-01-30 04:30:33,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dee362f6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@779dbedd}, log id: 506bfd72 >2014-01-30 04:30:33,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 6ef73216 >2014-01-30 04:30:34,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 6ef73216 >2014-01-30 04:30:34,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 27aeffff >2014-01-30 04:30:34,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27aeffff >2014-01-30 04:30:36,584 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:30:39,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1960a53c >2014-01-30 04:30:39,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1960a53c >2014-01-30 04:30:40,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 483b9337 >2014-01-30 04:30:40,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4c38e5d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15ce4070}, log id: 483b9337 >2014-01-30 04:30:40,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 433c37f6 >2014-01-30 04:30:40,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 433c37f6 >2014-01-30 04:30:40,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 6de491b9 >2014-01-30 04:30:41,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6de491b9 >2014-01-30 04:30:41,607 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:30:42,691 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) [23554188] No up server in cluster >2014-01-30 04:30:42,691 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) [23554188] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:30:42,694 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) [23554188] No up server in cluster >2014-01-30 04:30:42,695 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) [23554188] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:30:42,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 7b136047 >2014-01-30 04:30:43,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 7b136047 >2014-01-30 04:30:43,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterTasksListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 43084c04 >2014-01-30 04:30:43,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterTasksListVDSCommand, return: [], log id: 43084c04 >2014-01-30 04:30:46,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c79777c >2014-01-30 04:30:46,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: c79777c >2014-01-30 04:30:46,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 394b6cae >2014-01-30 04:30:46,628 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-39) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:30:46,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ab16351, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70dc3024}, log id: 394b6cae >2014-01-30 04:30:46,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 4db31d4c >2014-01-30 04:30:47,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 4db31d4c >2014-01-30 04:30:47,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 4784a534 >2014-01-30 04:30:47,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4784a534 >2014-01-30 04:30:51,649 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:30:52,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 39a5624a >2014-01-30 04:30:53,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 39a5624a >2014-01-30 04:30:53,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d9a9daf >2014-01-30 04:30:53,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b18bfe00, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@402db8d2}, log id: 1d9a9daf >2014-01-30 04:30:53,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 4e83810a >2014-01-30 04:30:53,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 4e83810a >2014-01-30 04:30:53,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 756bff3d >2014-01-30 04:30:54,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 756bff3d >2014-01-30 04:30:56,670 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:30:59,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51bc5ebf >2014-01-30 04:30:59,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 51bc5ebf >2014-01-30 04:30:59,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a188ae >2014-01-30 04:31:00,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e77e434c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcfc0aeb}, log id: 6a188ae >2014-01-30 04:31:00,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 6be7ebc1 >2014-01-30 04:31:00,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 6be7ebc1 >2014-01-30 04:31:00,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 564c875f >2014-01-30 04:31:00,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 564c875f >2014-01-30 04:31:01,693 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-53) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:31:05,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: bb57e7d >2014-01-30 04:31:06,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: bb57e7d >2014-01-30 04:31:06,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44cfb59b >2014-01-30 04:31:06,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@625ec968, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9baf7c1}, log id: 44cfb59b >2014-01-30 04:31:06,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 6754bc9f >2014-01-30 04:31:06,713 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:31:07,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 6754bc9f >2014-01-30 04:31:07,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 64ff7910 >2014-01-30 04:31:07,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64ff7910 >2014-01-30 04:31:11,733 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:31:12,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ebec0b3 >2014-01-30 04:31:12,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7ebec0b3 >2014-01-30 04:31:12,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: dc7f3c0 >2014-01-30 04:31:13,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af241c60, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f9e99bf}, log id: dc7f3c0 >2014-01-30 04:31:13,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 481d1757 >2014-01-30 04:31:13,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 481d1757 >2014-01-30 04:31:13,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 43bb568a >2014-01-30 04:31:13,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43bb568a >2014-01-30 04:31:16,757 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:31:18,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3607d61d >2014-01-30 04:31:19,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3607d61d >2014-01-30 04:31:19,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c73a45d >2014-01-30 04:31:19,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b0a8216, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6897c2db}, log id: c73a45d >2014-01-30 04:31:19,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 6e7d7c2b >2014-01-30 04:31:20,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 6e7d7c2b >2014-01-30 04:31:20,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 3ee34fd1 >2014-01-30 04:31:20,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ee34fd1 >2014-01-30 04:31:21,787 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:31:25,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 256f84f0 >2014-01-30 04:31:26,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 256f84f0 >2014-01-30 04:31:26,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5690a0bc >2014-01-30 04:31:26,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44a69702, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b1e4657}, log id: 5690a0bc >2014-01-30 04:31:26,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 54cd8839 >2014-01-30 04:31:26,815 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:31:26,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 54cd8839 >2014-01-30 04:31:26,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 5439f366 >2014-01-30 04:31:27,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5439f366 >2014-01-30 04:31:31,843 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:31:32,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f6a9734 >2014-01-30 04:31:32,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1f6a9734 >2014-01-30 04:31:32,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e5444d8 >2014-01-30 04:31:32,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d1d9ac4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e910833}, log id: 5e5444d8 >2014-01-30 04:31:32,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 78ae0638 >2014-01-30 04:31:33,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 78ae0638 >2014-01-30 04:31:33,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 4f0db503 >2014-01-30 04:31:33,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f0db503 >2014-01-30 04:31:36,830 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (pool-5-thread-37) [56fbc0ca] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: a4b2715f-4e23-4968-84bd-45a2015d690a Type: VDS >2014-01-30 04:31:36,860 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (pool-5-thread-37) [56fbc0ca] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: a4b2715f-4e23-4968-84bd-45a2015d690a Type: VDS >2014-01-30 04:31:36,860 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 04:31:36,864 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-37) [56fbc0ca] START, SetVdsStatusVDSCommand(HostName = host1, HostId = a4b2715f-4e23-4968-84bd-45a2015d690a, status=Maintenance, nonOperationalReason=NONE), log id: 25334431 >2014-01-30 04:31:36,871 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-37) [56fbc0ca] FINISH, SetVdsStatusVDSCommand, log id: 25334431 >2014-01-30 04:31:36,876 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-37) [56fbc0ca] Correlation ID: 56fbc0ca, Job ID: d9efa6c9-a97d-4ee9-b05b-429a85db07d5, Call Stack: null, Custom Event ID: -1, Message: Host host1 was switched to Maintenance mode by admin@internal. >2014-01-30 04:31:38,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: eed1a87 >2014-01-30 04:31:39,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: eed1a87 >2014-01-30 04:31:39,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 991f927 >2014-01-30 04:31:39,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f712baa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4ff3f8a}, log id: 991f927 >2014-01-30 04:31:39,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 43760e62 >2014-01-30 04:31:40,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 43760e62 >2014-01-30 04:31:40,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 30c026ac >2014-01-30 04:31:40,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30c026ac >2014-01-30 04:31:41,735 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-5) [5b302003] Lock Acquired to object EngineLock [exclusiveLocks= key: a4b2715f-4e23-4968-84bd-45a2015d690a value: VDS >, sharedLocks= ] >2014-01-30 04:31:41,753 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-5-thread-37) [5b302003] Running command: RemoveVdsCommand internal: false. Entities affected : ID: a4b2715f-4e23-4968-84bd-45a2015d690a Type: VDS >2014-01-30 04:31:41,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.RemoveGlusterServerVDSCommand] (pool-5-thread-37) [5b302003] START, RemoveGlusterServerVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 5f62c254 >2014-01-30 04:31:42,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.RemoveGlusterServerVDSCommand] (pool-5-thread-37) [5b302003] FINISH, RemoveGlusterServerVDSCommand, log id: 5f62c254 >2014-01-30 04:31:42,022 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-37) [5b302003] START, RemoveVdsVDSCommand( HostId = a4b2715f-4e23-4968-84bd-45a2015d690a), log id: 5da3d1e0 >2014-01-30 04:31:42,022 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-5-thread-37) [5b302003] vdsManager::disposing >2014-01-30 04:31:42,023 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-37) [5b302003] FINISH, RemoveVdsVDSCommand, log id: 5da3d1e0 >2014-01-30 04:31:42,027 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-37) [5b302003] Correlation ID: 5b302003, Call Stack: null, Custom Event ID: -1, Message: Host host1 was removed by admin@internal. >2014-01-30 04:31:42,027 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-5-thread-37) [5b302003] Lock freed to object EngineLock [exclusiveLocks= key: a4b2715f-4e23-4968-84bd-45a2015d690a value: VDS >, sharedLocks= ] >2014-01-30 04:31:43,511 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) [1f17c565] No up server in cluster >2014-01-30 04:31:43,511 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) [1f17c565] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:31:43,518 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) [1f17c565] No up server in cluster >2014-01-30 04:31:43,518 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) [1f17c565] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:31:43,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 5c7147b3 >2014-01-30 04:31:44,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 5c7147b3 >2014-01-30 04:31:44,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterTasksListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 73af3103 >2014-01-30 04:31:44,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterTasksListVDSCommand, return: [], log id: 73af3103 >2014-01-30 04:31:45,204 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-8) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:31:45,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f3afad9 >2014-01-30 04:31:45,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f3afad9 >2014-01-30 04:31:45,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3771933f >2014-01-30 04:31:46,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31b02d10, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4347f8ce}, log id: 3771933f >2014-01-30 04:31:46,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 73fd4be6 >2014-01-30 04:31:46,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED], log id: 73fd4be6 >2014-01-30 04:31:46,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 6d341637 >2014-01-30 04:31:46,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d341637 >2014-01-30 04:31:48,201 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-4) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:31:51,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56c0043b >2014-01-30 04:31:52,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 56c0043b >2014-01-30 04:31:52,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 525c7091 >2014-01-30 04:31:52,531 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-9) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:31:52,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7150f7a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff991dcc}, log id: 525c7091 >2014-01-30 04:31:52,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 391a14ee >2014-01-30 04:31:52,708 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-1) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:31:53,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED], log id: 391a14ee >2014-01-30 04:31:53,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 66563576 >2014-01-30 04:31:53,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66563576 >2014-01-30 04:31:54,710 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-7) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:31:54,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (ajp-/127.0.0.1:8702-4) START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 6f1016f5 >2014-01-30 04:31:55,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (ajp-/127.0.0.1:8702-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED], log id: 6f1016f5 >2014-01-30 04:31:58,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f1deb4a >2014-01-30 04:31:58,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f1deb4a >2014-01-30 04:31:58,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b32657e >2014-01-30 04:31:59,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d360b03f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7705dda0}, log id: 3b32657e >2014-01-30 04:31:59,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 177edf47 >2014-01-30 04:31:59,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED], log id: 177edf47 >2014-01-30 04:31:59,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 215641e2 >2014-01-30 04:31:59,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 215641e2 >2014-01-30 04:32:04,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e254cc3 >2014-01-30 04:32:05,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2e254cc3 >2014-01-30 04:32:05,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1622b102 >2014-01-30 04:32:05,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75b70bf8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83001bb5}, log id: 1622b102 >2014-01-30 04:32:05,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 6cf2bd6c >2014-01-30 04:32:06,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED], log id: 6cf2bd6c >2014-01-30 04:32:06,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 6b1425da >2014-01-30 04:32:06,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b1425da >2014-01-30 04:32:11,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 236078c8 >2014-01-30 04:32:11,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 236078c8 >2014-01-30 04:32:12,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c99ae79 >2014-01-30 04:32:12,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@855be68c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@595f4965}, log id: 2c99ae79 >2014-01-30 04:32:12,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 295d7dd9 >2014-01-30 04:32:12,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED], log id: 295d7dd9 >2014-01-30 04:32:12,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 4fdfbace >2014-01-30 04:32:12,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fdfbace >2014-01-30 04:32:18,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d7863cb >2014-01-30 04:32:18,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2d7863cb >2014-01-30 04:32:18,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c7934fc >2014-01-30 04:32:18,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2005c60b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8da5e3d0}, log id: 1c7934fc >2014-01-30 04:32:18,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 2b7f10e8 >2014-01-30 04:32:19,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED], log id: 2b7f10e8 >2014-01-30 04:32:19,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 752acc0b >2014-01-30 04:32:19,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 752acc0b >2014-01-30 04:32:24,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6309c05d >2014-01-30 04:32:25,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6309c05d >2014-01-30 04:32:25,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c0648bb >2014-01-30 04:32:25,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@777bbd71, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c0faa5b}, log id: 7c0648bb >2014-01-30 04:32:25,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 47e38849 >2014-01-30 04:32:25,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED], log id: 47e38849 >2014-01-30 04:32:25,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 226cbd95 >2014-01-30 04:32:26,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 226cbd95 >2014-01-30 04:32:31,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 763b17db >2014-01-30 04:32:31,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 763b17db >2014-01-30 04:32:31,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 268326ed >2014-01-30 04:32:31,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3efc99a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b104927}, log id: 268326ed >2014-01-30 04:32:31,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 7ce07180 >2014-01-30 04:32:32,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 7ce07180 >2014-01-30 04:32:32,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 1c3e9341 >2014-01-30 04:32:32,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c3e9341 >2014-01-30 04:32:37,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 301f78d0 >2014-01-30 04:32:38,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 301f78d0 >2014-01-30 04:32:38,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a781687 >2014-01-30 04:32:38,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c4dff8a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e537f53d}, log id: 1a781687 >2014-01-30 04:32:38,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 2bf494fe >2014-01-30 04:32:38,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 2bf494fe >2014-01-30 04:32:38,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 33cf1bd6 >2014-01-30 04:32:39,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33cf1bd6 >2014-01-30 04:32:44,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ff7444 >2014-01-30 04:32:44,319 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) [b80ce35] No up server in cluster >2014-01-30 04:32:44,319 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) [b80ce35] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:32:44,322 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) [b80ce35] No up server in cluster >2014-01-30 04:32:44,322 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) [b80ce35] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:32:44,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 484644c >2014-01-30 04:32:44,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7ff7444 >2014-01-30 04:32:44,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e594569 >2014-01-30 04:32:44,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 484644c >2014-01-30 04:32:44,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterTasksListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 31b798a0 >2014-01-30 04:32:44,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ef8208e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5da326c}, log id: 2e594569 >2014-01-30 04:32:44,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 4c53de88 >2014-01-30 04:32:45,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterTasksListVDSCommand, return: [], log id: 31b798a0 >2014-01-30 04:32:45,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 4c53de88 >2014-01-30 04:32:45,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 532bd5d0 >2014-01-30 04:32:45,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 532bd5d0 >2014-01-30 04:32:50,146 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-1) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:32:50,200 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-7) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:32:50,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19689d78 >2014-01-30 04:32:51,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 19689d78 >2014-01-30 04:32:51,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 727fb60c >2014-01-30 04:32:51,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af9a8216, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b9d52a2}, log id: 727fb60c >2014-01-30 04:32:51,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 2f1d7f58 >2014-01-30 04:32:52,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 2f1d7f58 >2014-01-30 04:32:52,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 2c75aff3 >2014-01-30 04:32:52,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c75aff3 >2014-01-30 04:32:52,569 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-5) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:32:52,683 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-4) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:32:54,357 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-11) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:32:54,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (ajp-/127.0.0.1:8702-1) START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 24724b20 >2014-01-30 04:32:54,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (ajp-/127.0.0.1:8702-1) FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 24724b20 >2014-01-30 04:32:56,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (ajp-/127.0.0.1:8702-5) START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 57de1fa2 >2014-01-30 04:32:56,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (ajp-/127.0.0.1:8702-5) FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 57de1fa2 >2014-01-30 04:32:57,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 45095e82 >2014-01-30 04:32:57,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (ajp-/127.0.0.1:8702-8) START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 1400817f >2014-01-30 04:32:57,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 45095e82 >2014-01-30 04:32:57,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4786fd58 >2014-01-30 04:32:58,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c1a020f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61162194}, log id: 4786fd58 >2014-01-30 04:32:58,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 56b089cb >2014-01-30 04:32:58,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (ajp-/127.0.0.1:8702-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 1400817f >2014-01-30 04:32:58,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 56b089cb >2014-01-30 04:32:58,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 1eb5cdd2 >2014-01-30 04:32:58,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1eb5cdd2 >2014-01-30 04:33:02,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (ajp-/127.0.0.1:8702-4) START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 2ff5e265 >2014-01-30 04:33:02,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (ajp-/127.0.0.1:8702-8) START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 56a9a123 >2014-01-30 04:33:02,839 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (pool-5-thread-37) [150f5db1] Running command: AddVdsCommand internal: false. Entities affected : ID: 0d368adf-557a-4706-9b3a-f6559a752a3f Type: VdsGroups >2014-01-30 04:33:02,855 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (pool-5-thread-37) [291cf4ae] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: b557c3ef-c01f-4196-9d9c-04c6b647922a Type: VDS >2014-01-30 04:33:02,859 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (pool-5-thread-37) [291cf4ae] Lock freed to object EngineLock [exclusiveLocks= key: 5849b030-626e-47cb-ad90-3ce782d831b3 value: REGISTER_VDS >, sharedLocks= ] >2014-01-30 04:33:02,860 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (pool-5-thread-37) [291cf4ae] Cannot get vdsManager for vdsid=b557c3ef-c01f-4196-9d9c-04c6b647922a >2014-01-30 04:33:02,861 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-37) [291cf4ae] START, RemoveVdsVDSCommand(HostName = host1, HostId = b557c3ef-c01f-4196-9d9c-04c6b647922a), log id: 70a57375 >2014-01-30 04:33:02,861 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (pool-5-thread-37) [291cf4ae] Cannot get vdsManager for vdsid=b557c3ef-c01f-4196-9d9c-04c6b647922a >2014-01-30 04:33:02,861 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-37) [291cf4ae] FINISH, RemoveVdsVDSCommand, log id: 70a57375 >2014-01-30 04:33:02,862 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (pool-5-thread-37) [291cf4ae] Cannot get vdsManager for vdsid=b557c3ef-c01f-4196-9d9c-04c6b647922a >2014-01-30 04:33:02,863 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (pool-5-thread-37) [291cf4ae] START, AddVdsVDSCommand(HostName = host1, HostId = b557c3ef-c01f-4196-9d9c-04c6b647922a), log id: e13dfe3 >2014-01-30 04:33:02,863 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (pool-5-thread-37) [291cf4ae] AddVds - entered , starting logic to add VDS b557c3ef-c01f-4196-9d9c-04c6b647922a >2014-01-30 04:33:02,864 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (pool-5-thread-37) [291cf4ae] AddVds - VDS b557c3ef-c01f-4196-9d9c-04c6b647922a was added, will try to add it to the resource manager >2014-01-30 04:33:02,864 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-5-thread-37) [291cf4ae] Entered VdsManager constructor >2014-01-30 04:33:02,875 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-5-thread-37) [291cf4ae] Initialize vdsBroker (host1,54,321) >2014-01-30 04:33:02,876 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (pool-5-thread-37) [291cf4ae] VDS b557c3ef-c01f-4196-9d9c-04c6b647922a was added to the Resource Manager >2014-01-30 04:33:02,876 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (pool-5-thread-37) [291cf4ae] FINISH, AddVdsVDSCommand, log id: e13dfe3 >2014-01-30 04:33:02,887 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-37) [291cf4ae] Correlation ID: 150f5db1, Job ID: 6f29cc50-25cd-4cc6-90bc-6e69e5d1c469, Call Stack: null, Custom Event ID: -1, Message: Host host1 was added by admin@internal. >2014-01-30 04:33:02,889 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-43) [5feadbae] Lock Acquired to object EngineLock [exclusiveLocks= key: b557c3ef-c01f-4196-9d9c-04c6b647922a value: VDS >, sharedLocks= ] >2014-01-30 04:33:02,896 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-43) [5feadbae] Running command: InstallVdsCommand internal: true. Entities affected : ID: b557c3ef-c01f-4196-9d9c-04c6b647922a Type: VDS >2014-01-30 04:33:02,896 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-43) [5feadbae] Before Installation host b557c3ef-c01f-4196-9d9c-04c6b647922a, host1 >2014-01-30 04:33:02,898 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-43) [5feadbae] START, SetVdsStatusVDSCommand(HostName = host1, HostId = b557c3ef-c01f-4196-9d9c-04c6b647922a, status=Installing, nonOperationalReason=NONE), log id: 336979eb >2014-01-30 04:33:02,901 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-43) [5feadbae] FINISH, SetVdsStatusVDSCommand, log id: 336979eb >2014-01-30 04:33:02,973 INFO [org.ovirt.engine.core.bll.InstallerMessages] (pool-5-thread-43) [5feadbae] Installation host1: Connected to host host1 with SSH key fingerprint: a5:c8:7c:b7:40:4f:92:45:9b:86:04:47:25:44:ed:3f >2014-01-30 04:33:02,980 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-43) [5feadbae] Correlation ID: 5feadbae, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Connected to host host1 with SSH key fingerprint: a5:c8:7c:b7:40:4f:92:45:9b:86:04:47:25:44:ed:3f. >2014-01-30 04:33:03,005 INFO [org.ovirt.engine.core.bll.VdsDeploy] (pool-5-thread-43) [5feadbae] Installation of host1. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-01-30 04:33:03,012 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-5-thread-43) SSH execute root@host1 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-01-30 04:33:03,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (ajp-/127.0.0.1:8702-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 2ff5e265 >2014-01-30 04:33:03,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (ajp-/127.0.0.1:8702-8) FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 56a9a123 >2014-01-30 04:33:03,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d5a5dbf >2014-01-30 04:33:03,875 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Initializing >2014-01-30 04:33:03,884 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5feadbae, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Initializing. >2014-01-30 04:33:03,904 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Environment setup >2014-01-30 04:33:03,906 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-6) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:33:03,910 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5feadbae, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Environment setup. >2014-01-30 04:33:03,920 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Environment packages setup >2014-01-30 04:33:03,925 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5feadbae, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Environment packages setup. >2014-01-30 04:33:04,185 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-9) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:33:04,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7d5a5dbf >2014-01-30 04:33:04,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b1c8003 >2014-01-30 04:33:04,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54a6750c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd656dc4}, log id: 5b1c8003 >2014-01-30 04:33:04,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 38fb8aab >2014-01-30 04:33:05,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 38fb8aab >2014-01-30 04:33:05,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 3beaf9e3 >2014-01-30 04:33:05,313 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Programs detection >2014-01-30 04:33:05,319 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5feadbae, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Programs detection. >2014-01-30 04:33:05,319 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Environment customization >2014-01-30 04:33:05,324 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5feadbae, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Environment customization. >2014-01-30 04:33:05,382 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Logs at host located at: '/tmp/ovirt-host-deploy-20140130043302.log' >2014-01-30 04:33:05,389 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5feadbae, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Logs at host located at: '/tmp/ovirt-host-deploy-20140130043302.log'. >2014-01-30 04:33:05,447 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host host1 reports unique id 06DBBCA2-4B43-5948-9A88-7BE15E391E01 >2014-01-30 04:33:05,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3beaf9e3 >2014-01-30 04:33:05,464 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 06DBBCA2-4B43-5948-9A88-7BE15E391E01 to Host host1 >2014-01-30 04:33:05,607 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Setup validation >2014-01-30 04:33:05,615 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5feadbae, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Setup validation. >2014-01-30 04:33:05,878 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-90) [c894cd9] Initializing Host: host1 >2014-01-30 04:33:05,900 WARN [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Cannot validate host name settings, reason: cannot resolve own name 'rhs.1' >2014-01-30 04:33:05,908 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5feadbae, Call Stack: null, Custom Event ID: -1, Message: Host host1 installation in progress . Cannot validate host name settings, reason: cannot resolve own name 'rhs.1'. >2014-01-30 04:33:06,142 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Transaction setup >2014-01-30 04:33:06,151 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5feadbae, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Transaction setup. >2014-01-30 04:33:06,188 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Misc configuration >2014-01-30 04:33:06,195 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5feadbae, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Misc configuration. >2014-01-30 04:33:06,196 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Package installation >2014-01-30 04:33:06,202 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5feadbae, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Package installation. >2014-01-30 04:33:07,207 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-2) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:33:08,232 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-10) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:33:08,263 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-4) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:33:08,519 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Misc configuration >2014-01-30 04:33:08,527 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5feadbae, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Misc configuration. >2014-01-30 04:33:08,538 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Setting time >2014-01-30 04:33:08,547 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5feadbae, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Setting time. >2014-01-30 04:33:10,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e013ead >2014-01-30 04:33:10,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4e013ead >2014-01-30 04:33:10,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 667849b5 >2014-01-30 04:33:10,943 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Enrolling certificate >2014-01-30 04:33:10,950 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5feadbae, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Enrolling certificate. >2014-01-30 04:33:11,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4725081d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4033140}, log id: 667849b5 >2014-01-30 04:33:11,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 25b6affd >2014-01-30 04:33:11,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 25b6affd >2014-01-30 04:33:11,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 664228ef >2014-01-30 04:33:12,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 664228ef >2014-01-30 04:33:12,028 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Transaction commit >2014-01-30 04:33:12,033 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5feadbae, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Transaction commit. >2014-01-30 04:33:12,098 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Closing up >2014-01-30 04:33:12,106 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5feadbae, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Closing up. >2014-01-30 04:33:12,106 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Starting gluster >2014-01-30 04:33:12,114 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5feadbae, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Starting gluster. >2014-01-30 04:33:17,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e044fa9 >2014-01-30 04:33:17,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6e044fa9 >2014-01-30 04:33:17,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3bae3faf >2014-01-30 04:33:17,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4032ee6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@350919bf}, log id: 3bae3faf >2014-01-30 04:33:17,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 61419603 >2014-01-30 04:33:18,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:DISCONNECTED], log id: 61419603 >2014-01-30 04:33:18,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 333ce514 >2014-01-30 04:33:18,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 333ce514 >2014-01-30 04:33:18,965 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Starting vdsm >2014-01-30 04:33:18,971 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5feadbae, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Starting vdsm. >2014-01-30 04:33:21,634 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Pre-termination >2014-01-30 04:33:21,642 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5feadbae, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Pre-termination. >2014-01-30 04:33:21,666 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140130043321-host1-5feadbae.log' >2014-01-30 04:33:21,673 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5feadbae, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140130043321-host1-5feadbae.log'. >2014-01-30 04:33:21,945 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Termination >2014-01-30 04:33:21,954 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 5feadbae, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Termination. >2014-01-30 04:33:22,030 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-43) [5feadbae] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:33:22,031 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-43) [5feadbae] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:33:22,533 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-43) [5feadbae] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:33:22,533 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-43) [5feadbae] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:33:23,036 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-43) [5feadbae] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:33:23,036 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-43) [5feadbae] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:33:23,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26109a01 >2014-01-30 04:33:23,563 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (pool-5-thread-43) [5feadbae] Engine managed to communicate with VDSM agent on host host1 >2014-01-30 04:33:23,732 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (pool-5-thread-43) [34602f67] Running command: SetupNetworksCommand internal: true. Entities affected : ID: b557c3ef-c01f-4196-9d9c-04c6b647922a Type: VDS >2014-01-30 04:33:23,733 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-5-thread-43) [34602f67] START, SetupNetworksVDSCommand(HostName = host1, HostId = b557c3ef-c01f-4196-9d9c-04c6b647922a, force=false, checkConnectivity=true, conectivityTimeout=120, > networks=[ovirtmgmt {id=00000000-0000-0000-0000-000000000009, description=Management Network, comment=null, subnet=null, gateway=null, type=null, vlanId=null, stp=false, dataCenterId=5849b030-626e-47cb-ad90-3ce782d831b3, mtu=0, vmNetwork=true, cluster=NetworkCluster {id={clusterId=null, networkId=null}, status=OPERATIONAL, display=false, required=true, migration=false}, providedBy=null, label=null}], > bonds=[], > interfaces=[eth1 {id=b5cee029-4826-4e01-927b-84b572e912ca, vdsId=b557c3ef-c01f-4196-9d9c-04c6b647922a, macAddress=52:54:00:50:00:cc, networkName=null, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=DHCP, address=10.70.37.149, subnet=255.255.254.0, gateway=null, mtu=1500, bridged=false, speed=100, type=0, networkImplementationDetails=null}, > eth0 {id=e20766ea-b948-43b7-8f6a-8c8b727285bf, vdsId=b557c3ef-c01f-4196-9d9c-04c6b647922a, macAddress=52:54:00:85:81:9e, networkName=ovirtmgmt, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=DHCP, address=10.70.37.71, subnet=255.255.254.0, gateway=null, mtu=1500, bridged=false, speed=100, type=0, networkImplementationDetails=null}], > removedNetworks=[], > removedBonds=[]), log id: 3ca9d304 >2014-01-30 04:33:23,734 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-5-thread-43) [34602f67] FINISH, SetupNetworksVDSCommand, log id: 3ca9d304 >2014-01-30 04:33:23,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 26109a01 >2014-01-30 04:33:23,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 483fe425 >2014-01-30 04:33:24,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c58520b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6c8515}, log id: 483fe425 >2014-01-30 04:33:24,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 1b7e32ba >2014-01-30 04:33:24,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 1b7e32ba >2014-01-30 04:33:24,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 260ada8d >2014-01-30 04:33:24,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 260ada8d >2014-01-30 04:33:27,397 INFO [org.ovirt.engine.core.bll.network.host.CommitNetworkChangesCommand] (pool-5-thread-43) [18267dc2] Running command: CommitNetworkChangesCommand internal: true. Entities affected : ID: b557c3ef-c01f-4196-9d9c-04c6b647922a Type: VDS >2014-01-30 04:33:27,399 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (pool-5-thread-43) [18267dc2] START, SetSafeNetworkConfigVDSCommand(HostName = host1, HostId = b557c3ef-c01f-4196-9d9c-04c6b647922a), log id: 2d735389 >2014-01-30 04:33:27,432 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (pool-5-thread-43) [18267dc2] FINISH, SetSafeNetworkConfigVDSCommand, log id: 2d735389 >2014-01-30 04:33:27,441 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-43) [18267dc2] Correlation ID: 18267dc2, Call Stack: null, Custom Event ID: -1, Message: Network changes were saved on host host1 >2014-01-30 04:33:27,444 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-43) [18267dc2] START, SetVdsStatusVDSCommand(HostName = host1, HostId = b557c3ef-c01f-4196-9d9c-04c6b647922a, status=Initializing, nonOperationalReason=NONE), log id: 294de7f2 >2014-01-30 04:33:27,447 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-43) [18267dc2] FINISH, SetVdsStatusVDSCommand, log id: 294de7f2 >2014-01-30 04:33:27,447 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-43) [18267dc2] After Installation host host1, VDS >2014-01-30 04:33:27,455 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-43) [18267dc2] Correlation ID: 5feadbae, Job ID: 6f29cc50-25cd-4cc6-90bc-6e69e5d1c469, Call Stack: null, Custom Event ID: -1, Message: Host host1 installed >2014-01-30 04:33:27,461 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-43) [18267dc2] Lock freed to object EngineLock [exclusiveLocks= key: b557c3ef-c01f-4196-9d9c-04c6b647922a value: VDS >, sharedLocks= ] >2014-01-30 04:33:29,974 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] START, GetHardwareInfoVDSCommand(HostName = host1, HostId = b557c3ef-c01f-4196-9d9c-04c6b647922a, vds=Host[host1]), log id: 48f32250 >2014-01-30 04:33:30,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 298249dc >2014-01-30 04:33:30,035 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] FINISH, GetHardwareInfoVDSCommand, log id: 48f32250 >2014-01-30 04:33:30,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] START, GlusterServersListVDSCommand(HostName = host1, HostId = b557c3ef-c01f-4196-9d9c-04c6b647922a), log id: 65b18de9 >2014-01-30 04:33:30,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 298249dc >2014-01-30 04:33:30,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d3bd6ab >2014-01-30 04:33:30,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.149:CONNECTED, 10.70.37.158:CONNECTED], log id: 65b18de9 >2014-01-30 04:33:30,540 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] START, GetHardwareInfoVDSCommand(HostName = host1, HostId = b557c3ef-c01f-4196-9d9c-04c6b647922a, vds=Host[host1]), log id: 29e64bba >2014-01-30 04:33:30,550 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] FINISH, GetHardwareInfoVDSCommand, log id: 29e64bba >2014-01-30 04:33:30,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] START, GlusterServersListVDSCommand(HostName = host1, HostId = b557c3ef-c01f-4196-9d9c-04c6b647922a), log id: 39314d3b >2014-01-30 04:33:30,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4979300, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4f842ee}, log id: 7d3bd6ab >2014-01-30 04:33:30,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 61b9ba36 >2014-01-30 04:33:30,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [7c7776a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.149:CONNECTED, 10.70.37.158:CONNECTED], log id: 39314d3b >2014-01-30 04:33:30,994 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-6) [7c7776a1] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host host1. >2014-01-30 04:33:31,001 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-6) [34dc6b9f] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 5849b030-626e-47cb-ad90-3ce782d831b3 Type: StoragePool >2014-01-30 04:33:31,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHostUUIDVDSCommand] (DefaultQuartzScheduler_Worker-6) [34dc6b9f] START, GetGlusterHostUUIDVDSCommand(HostName = host1, HostId = b557c3ef-c01f-4196-9d9c-04c6b647922a), log id: 36dec190 >2014-01-30 04:33:31,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 61b9ba36 >2014-01-30 04:33:31,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 5b60482 >2014-01-30 04:33:31,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHostUUIDVDSCommand] (DefaultQuartzScheduler_Worker-6) [34dc6b9f] FINISH, GetGlusterHostUUIDVDSCommand, return: d225e373-5036-4d81-b7b1-2019fec278f3, log id: 36dec190 >2014-01-30 04:33:31,233 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-6) [34dc6b9f] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 0d368adf-557a-4706-9b3a-f6559a752a3f value: GLUSTER >, sharedLocks= ] >2014-01-30 04:33:31,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b60482 >2014-01-30 04:33:31,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [34dc6b9f] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 435842a8 >2014-01-30 04:33:31,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [34dc6b9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 435842a8 >2014-01-30 04:33:31,879 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: b557c3ef-c01f-4196-9d9c-04c6b647922a Type: VDS >2014-01-30 04:33:36,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5af1de1e >2014-01-30 04:33:36,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5af1de1e >2014-01-30 04:33:36,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17ff753a >2014-01-30 04:33:37,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@408aed76, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67d607e6}, log id: 17ff753a >2014-01-30 04:33:37,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = host1, HostId = b557c3ef-c01f-4196-9d9c-04c6b647922a), log id: fdbe148 >2014-01-30 04:33:37,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.149:CONNECTED, 10.70.37.158:CONNECTED], log id: fdbe148 >2014-01-30 04:33:37,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = b557c3ef-c01f-4196-9d9c-04c6b647922a), log id: d9aa05a >2014-01-30 04:33:37,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d9aa05a >2014-01-30 04:33:42,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15c78724 >2014-01-30 04:33:43,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 15c78724 >2014-01-30 04:33:43,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27cf342c >2014-01-30 04:33:43,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@906b0717, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbb7c461}, log id: 27cf342c >2014-01-30 04:33:43,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = host1, HostId = b557c3ef-c01f-4196-9d9c-04c6b647922a), log id: 6a12f3fd >2014-01-30 04:33:44,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.149:CONNECTED, 10.70.37.158:CONNECTED], log id: 6a12f3fd >2014-01-30 04:33:44,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = b557c3ef-c01f-4196-9d9c-04c6b647922a), log id: 2be13faa >2014-01-30 04:33:44,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2be13faa >2014-01-30 04:33:45,147 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-50) No up server in cluster >2014-01-30 04:33:45,148 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-50) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:33:45,151 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-50) No up server in cluster >2014-01-30 04:33:45,151 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-50) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:33:45,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 4707b302 >2014-01-30 04:33:45,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4707b302 >2014-01-30 04:33:45,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterTasksListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 62752ac6 >2014-01-30 04:33:45,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterTasksListVDSCommand, return: [], log id: 62752ac6 >2014-01-30 04:33:49,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5fb60ee7 >2014-01-30 04:33:49,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5fb60ee7 >2014-01-30 04:33:49,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49047163 >2014-01-30 04:33:50,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83b52659, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fa1acd8}, log id: 49047163 >2014-01-30 04:33:50,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = host1, HostId = b557c3ef-c01f-4196-9d9c-04c6b647922a), log id: 2959cda6 >2014-01-30 04:33:50,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.149:CONNECTED, 10.70.37.158:CONNECTED], log id: 2959cda6 >2014-01-30 04:33:50,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = host1, HostId = b557c3ef-c01f-4196-9d9c-04c6b647922a), log id: e2561ab >2014-01-30 04:33:51,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e2561ab >2014-01-30 04:33:56,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 187fbf6b >2014-01-30 04:33:56,471 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (pool-5-thread-43) [8ae24f7] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: b557c3ef-c01f-4196-9d9c-04c6b647922a Type: VDS >2014-01-30 04:33:56,474 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-43) [8ae24f7] START, SetVdsStatusVDSCommand(HostName = host1, HostId = b557c3ef-c01f-4196-9d9c-04c6b647922a, status=PreparingForMaintenance, nonOperationalReason=NONE), log id: 595490fa >2014-01-30 04:33:56,480 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-43) [8ae24f7] FINISH, SetVdsStatusVDSCommand, log id: 595490fa >2014-01-30 04:33:56,502 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (pool-5-thread-43) [8ae24f7] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: b557c3ef-c01f-4196-9d9c-04c6b647922a Type: VDS >2014-01-30 04:33:56,509 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-43) [8ae24f7] Correlation ID: 8ae24f7, Job ID: 7229456d-4ffc-475d-9ff5-837f3969924f, Call Stack: null, Custom Event ID: -1, Message: Host host1 was switched to Maintenance mode by admin@internal. >2014-01-30 04:33:56,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 187fbf6b >2014-01-30 04:33:56,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ad9eed >2014-01-30 04:33:56,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a23f7a2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4a98fa2}, log id: 3ad9eed >2014-01-30 04:33:56,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 3aac2dae >2014-01-30 04:33:57,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 3aac2dae >2014-01-30 04:33:57,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 702e184b >2014-01-30 04:33:57,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 702e184b >2014-01-30 04:33:59,140 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-24) [3310e3f9] Updated vds status from Preparing for Maintenance to Maintenance in database, vds = b557c3ef-c01f-4196-9d9c-04c6b647922a : host1 >2014-01-30 04:33:59,157 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-5-thread-43) Clearing cache of pool: 5849b030-626e-47cb-ad90-3ce782d831b3 for problematic entities of VDS: host1. >2014-01-30 04:34:02,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6124a716 >2014-01-30 04:34:03,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6124a716 >2014-01-30 04:34:03,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7dfab8b7 >2014-01-30 04:34:03,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9f6f5db, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@344d5a76}, log id: 7dfab8b7 >2014-01-30 04:34:03,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 5a3962ab >2014-01-30 04:34:03,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 5a3962ab >2014-01-30 04:34:03,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 68bbb5d5 >2014-01-30 04:34:04,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68bbb5d5 >2014-01-30 04:34:09,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 672b48a2 >2014-01-30 04:34:09,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 672b48a2 >2014-01-30 04:34:09,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a8a84ad >2014-01-30 04:34:09,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@216a20e0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89ed3549}, log id: 5a8a84ad >2014-01-30 04:34:09,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 2d2d4a4a >2014-01-30 04:34:10,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED, host1:CONNECTED], log id: 2d2d4a4a >2014-01-30 04:34:10,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 6efdd01a >2014-01-30 04:34:10,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6efdd01a >2014-01-30 04:34:11,019 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-2) [51792f71] Lock Acquired to object EngineLock [exclusiveLocks= key: b557c3ef-c01f-4196-9d9c-04c6b647922a value: VDS >, sharedLocks= ] >2014-01-30 04:34:11,035 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-5-thread-47) [51792f71] Running command: RemoveVdsCommand internal: false. Entities affected : ID: b557c3ef-c01f-4196-9d9c-04c6b647922a Type: VDS >2014-01-30 04:34:11,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.RemoveGlusterServerVDSCommand] (pool-5-thread-47) [51792f71] START, RemoveGlusterServerVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 5ab08b6d >2014-01-30 04:34:11,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.RemoveGlusterServerVDSCommand] (pool-5-thread-47) [51792f71] FINISH, RemoveGlusterServerVDSCommand, log id: 5ab08b6d >2014-01-30 04:34:11,300 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-47) [51792f71] START, RemoveVdsVDSCommand( HostId = b557c3ef-c01f-4196-9d9c-04c6b647922a), log id: 3ac3be61 >2014-01-30 04:34:11,301 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-5-thread-47) [51792f71] vdsManager::disposing >2014-01-30 04:34:11,302 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-47) [51792f71] FINISH, RemoveVdsVDSCommand, log id: 3ac3be61 >2014-01-30 04:34:11,304 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-47) [51792f71] Correlation ID: 51792f71, Call Stack: null, Custom Event ID: -1, Message: Host host1 was removed by admin@internal. >2014-01-30 04:34:11,304 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-5-thread-47) [51792f71] Lock freed to object EngineLock [exclusiveLocks= key: b557c3ef-c01f-4196-9d9c-04c6b647922a value: VDS >, sharedLocks= ] >2014-01-30 04:34:12,935 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-11) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:34:14,394 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-5) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:34:15,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 281083a8 >2014-01-30 04:34:16,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 281083a8 >2014-01-30 04:34:16,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5fd1f226 >2014-01-30 04:34:16,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6aa9bffc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ea39e46}, log id: 5fd1f226 >2014-01-30 04:34:16,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 796c49c1 >2014-01-30 04:34:17,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED], log id: 796c49c1 >2014-01-30 04:34:17,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: c2a209 >2014-01-30 04:34:17,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c2a209 >2014-01-30 04:34:22,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5432956c >2014-01-30 04:34:22,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5432956c >2014-01-30 04:34:22,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1756ec8c >2014-01-30 04:34:23,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f51c6569, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fbd2d3c}, log id: 1756ec8c >2014-01-30 04:34:23,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 67f1c762 >2014-01-30 04:34:23,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED], log id: 67f1c762 >2014-01-30 04:34:23,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 6666f7a >2014-01-30 04:34:23,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6666f7a >2014-01-30 04:34:28,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c4437dd >2014-01-30 04:34:29,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: c4437dd >2014-01-30 04:34:29,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b2fe994 >2014-01-30 04:34:29,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e850468f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6f99f81}, log id: 1b2fe994 >2014-01-30 04:34:29,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 6e486410 >2014-01-30 04:34:30,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED], log id: 6e486410 >2014-01-30 04:34:30,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 7fc09172 >2014-01-30 04:34:30,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fc09172 >2014-01-30 04:34:35,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6076d813 >2014-01-30 04:34:35,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6076d813 >2014-01-30 04:34:35,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 980be5c >2014-01-30 04:34:36,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd638f8d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6700124c}, log id: 980be5c >2014-01-30 04:34:36,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 2d0c8b43 >2014-01-30 04:34:36,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED], log id: 2d0c8b43 >2014-01-30 04:34:36,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 52d59d4f >2014-01-30 04:34:36,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52d59d4f >2014-01-30 04:34:41,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 57b22c03 >2014-01-30 04:34:42,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 57b22c03 >2014-01-30 04:34:42,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 784b7452 >2014-01-30 04:34:42,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@430e0e96, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b77b856}, log id: 784b7452 >2014-01-30 04:34:42,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 243019f0 >2014-01-30 04:34:43,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.158:CONNECTED], log id: 243019f0 >2014-01-30 04:34:43,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 5a5cd5fa >2014-01-30 04:34:43,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a5cd5fa >2014-01-30 04:34:43,877 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (pool-5-thread-47) [36ba33b5] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: e6c3a069-c89e-4562-b99b-4981ac1874f5 Type: VDS >2014-01-30 04:34:43,881 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-47) [36ba33b5] START, SetVdsStatusVDSCommand(HostName = 10.70.37.216, HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5, status=PreparingForMaintenance, nonOperationalReason=NONE), log id: 6a4165ac >2014-01-30 04:34:43,887 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-47) [36ba33b5] FINISH, SetVdsStatusVDSCommand, log id: 6a4165ac >2014-01-30 04:34:43,913 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (pool-5-thread-47) [36ba33b5] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: e6c3a069-c89e-4562-b99b-4981ac1874f5 Type: VDS >2014-01-30 04:34:43,918 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-47) [36ba33b5] Correlation ID: 36ba33b5, Job ID: be0115b9-3cb4-4497-94c0-775b9c900601, Call Stack: null, Custom Event ID: -1, Message: Host 10.70.37.216 was switched to Maintenance mode by admin@internal. >2014-01-30 04:34:45,207 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-57) [4166d263] Updated vds status from Preparing for Maintenance to Maintenance in database, vds = e6c3a069-c89e-4562-b99b-4981ac1874f5 : 10.70.37.216 >2014-01-30 04:34:45,222 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (pool-5-thread-43) Clearing cache of pool: 5849b030-626e-47cb-ad90-3ce782d831b3 for problematic entities of VDS: 10.70.37.216. >2014-01-30 04:34:45,960 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-66) [62e25ce] No up server in cluster >2014-01-30 04:34:45,960 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-66) [62e25ce] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:34:45,963 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-66) [62e25ce] No up server in cluster >2014-01-30 04:34:45,963 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-66) [62e25ce] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:34:45,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 6c08dd45 >2014-01-30 04:34:46,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 6c08dd45 >2014-01-30 04:34:46,548 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-66) [62e25ce] No up server in cluster >2014-01-30 04:34:46,548 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-66) [62e25ce] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:34:47,559 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-9) [5b59f7e5] Lock Acquired to object EngineLock [exclusiveLocks= key: e6c3a069-c89e-4562-b99b-4981ac1874f5 value: VDS >, sharedLocks= ] >2014-01-30 04:34:47,577 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-5-thread-47) [5b59f7e5] Running command: RemoveVdsCommand internal: false. Entities affected : ID: e6c3a069-c89e-4562-b99b-4981ac1874f5 Type: VDS >2014-01-30 04:34:47,603 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-47) [5b59f7e5] START, RemoveVdsVDSCommand( HostId = e6c3a069-c89e-4562-b99b-4981ac1874f5), log id: 33d4e8b8 >2014-01-30 04:34:47,603 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-5-thread-47) [5b59f7e5] vdsManager::disposing >2014-01-30 04:34:47,603 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-47) [5b59f7e5] FINISH, RemoveVdsVDSCommand, log id: 33d4e8b8 >2014-01-30 04:34:47,606 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-47) [5b59f7e5] Correlation ID: 5b59f7e5, Call Stack: null, Custom Event ID: -1, Message: Host 10.70.37.216 was removed by admin@internal. >2014-01-30 04:34:47,606 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-5-thread-47) [5b59f7e5] Lock freed to object EngineLock [exclusiveLocks= key: e6c3a069-c89e-4562-b99b-4981ac1874f5 value: VDS >, sharedLocks= ] >2014-01-30 04:34:47,904 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-3) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:34:48,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 7b099c0a >2014-01-30 04:34:48,546 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-39) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 04:34:48,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@5ed10f63, log id: 7b099c0a >2014-01-30 04:34:48,706 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-39) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 04:34:48,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 6f495d36 >2014-01-30 04:34:48,827 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-39) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 04:34:48,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@36bde3bc, log id: 6f495d36 >2014-01-30 04:34:48,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6cb267b7 >2014-01-30 04:34:49,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6cb267b7 >2014-01-30 04:34:49,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52300df0 >2014-01-30 04:34:49,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9afa3e11, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e61e4c70}, log id: 52300df0 >2014-01-30 04:34:54,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68e28c83 >2014-01-30 04:34:55,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 68e28c83 >2014-01-30 04:34:55,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 137531f0 >2014-01-30 04:34:55,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec63ba09, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@429244e2}, log id: 137531f0 >2014-01-30 04:35:00,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25523682 >2014-01-30 04:35:01,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 25523682 >2014-01-30 04:35:01,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2dd61e59 >2014-01-30 04:35:01,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed2db595, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@202eb677}, log id: 2dd61e59 >2014-01-30 04:35:06,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 73cfeb0f >2014-01-30 04:35:06,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 73cfeb0f >2014-01-30 04:35:06,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78dfd0f2 >2014-01-30 04:35:07,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfd1e239, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41e5803e}, log id: 78dfd0f2 >2014-01-30 04:35:12,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6738a780 >2014-01-30 04:35:12,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6738a780 >2014-01-30 04:35:12,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2faf4703 >2014-01-30 04:35:13,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81e542a8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfe9550c}, log id: 2faf4703 >2014-01-30 04:35:18,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23297d09 >2014-01-30 04:35:18,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 23297d09 >2014-01-30 04:35:18,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 795935d9 >2014-01-30 04:35:18,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3d870c6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@451a97c1}, log id: 795935d9 >2014-01-30 04:35:23,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 255e33b >2014-01-30 04:35:24,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 255e33b >2014-01-30 04:35:24,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21f65de >2014-01-30 04:35:24,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@858192dc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24535416}, log id: 21f65de >2014-01-30 04:35:29,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77f3bc87 >2014-01-30 04:35:30,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 77f3bc87 >2014-01-30 04:35:30,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2996b72f >2014-01-30 04:35:30,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77085e46, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd36d405}, log id: 2996b72f >2014-01-30 04:35:35,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 284247 >2014-01-30 04:35:36,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 284247 >2014-01-30 04:35:36,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54e5bd45 >2014-01-30 04:35:36,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52e1dd17, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4a100fb}, log id: 54e5bd45 >2014-01-30 04:35:41,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 641ef8f8 >2014-01-30 04:35:41,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 641ef8f8 >2014-01-30 04:35:41,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67b50ff1 >2014-01-30 04:35:42,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91ed2906, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12eaa58b}, log id: 67b50ff1 >2014-01-30 04:35:46,557 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) [5049497] No up server in cluster >2014-01-30 04:35:46,557 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) [5049497] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:35:46,560 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) [5049497] No up server in cluster >2014-01-30 04:35:46,561 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) [5049497] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:35:46,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 6c168591 >2014-01-30 04:35:47,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 6c168591 >2014-01-30 04:35:47,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7da3db0e >2014-01-30 04:35:47,129 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) [5049497] No up server in cluster >2014-01-30 04:35:47,129 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) [5049497] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:35:47,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7da3db0e >2014-01-30 04:35:47,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49d772cb >2014-01-30 04:35:47,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2a7bb7a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee10bfba}, log id: 49d772cb >2014-01-30 04:35:52,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12030c10 >2014-01-30 04:35:53,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 12030c10 >2014-01-30 04:35:53,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8ca4169 >2014-01-30 04:35:53,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26e9ebf1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3b989b2}, log id: 8ca4169 >2014-01-30 04:35:58,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1349bbeb >2014-01-30 04:35:59,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1349bbeb >2014-01-30 04:35:59,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37391ff5 >2014-01-30 04:35:59,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5e6da00, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd103e9a}, log id: 37391ff5 >2014-01-30 04:36:04,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2394067c >2014-01-30 04:36:05,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2394067c >2014-01-30 04:36:05,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4dd6750b >2014-01-30 04:36:05,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e95cb01, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a080cb0}, log id: 4dd6750b >2014-01-30 04:36:10,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3310e99c >2014-01-30 04:36:10,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3310e99c >2014-01-30 04:36:10,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33fd1438 >2014-01-30 04:36:11,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89fbcd6f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fb37a11}, log id: 33fd1438 >2014-01-30 04:36:16,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74aecb81 >2014-01-30 04:36:16,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 74aecb81 >2014-01-30 04:36:16,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 628c8c84 >2014-01-30 04:36:16,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bad43e66, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2f72343}, log id: 628c8c84 >2014-01-30 04:36:21,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ce9484f >2014-01-30 04:36:22,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: ce9484f >2014-01-30 04:36:22,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c167171 >2014-01-30 04:36:22,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2bd30587, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34826864}, log id: 5c167171 >2014-01-30 04:36:27,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 424381d0 >2014-01-30 04:36:28,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 424381d0 >2014-01-30 04:36:28,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3971a16b >2014-01-30 04:36:28,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3acca80, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a85be057}, log id: 3971a16b >2014-01-30 04:36:33,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37ebdda7 >2014-01-30 04:36:34,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 37ebdda7 >2014-01-30 04:36:34,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c5c5a17 >2014-01-30 04:36:34,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6bb56a80, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69ebcd2b}, log id: 4c5c5a17 >2014-01-30 04:36:39,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2144443c >2014-01-30 04:36:40,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2144443c >2014-01-30 04:36:40,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f866873 >2014-01-30 04:36:40,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb63f376, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ece20a}, log id: 3f866873 >2014-01-30 04:36:45,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6261c213 >2014-01-30 04:36:45,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6261c213 >2014-01-30 04:36:45,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 34a51d89 >2014-01-30 04:36:46,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bfb66f7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b70e84e6}, log id: 34a51d89 >2014-01-30 04:36:47,137 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) [4376cca4] No up server in cluster >2014-01-30 04:36:47,138 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) [4376cca4] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:36:47,141 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) [4376cca4] No up server in cluster >2014-01-30 04:36:47,141 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) [4376cca4] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:36:47,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 297d4ffa >2014-01-30 04:36:47,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 297d4ffa >2014-01-30 04:36:47,706 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) [4376cca4] No up server in cluster >2014-01-30 04:36:47,706 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) [4376cca4] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:36:51,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 73d1e215 >2014-01-30 04:36:51,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 73d1e215 >2014-01-30 04:36:51,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7df2c352 >2014-01-30 04:36:51,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc78c2d0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b945018}, log id: 7df2c352 >2014-01-30 04:36:57,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14dfe50c >2014-01-30 04:36:57,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 14dfe50c >2014-01-30 04:36:57,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7df8c3d0 >2014-01-30 04:36:57,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d90ef301, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72600078}, log id: 7df8c3d0 >2014-01-30 04:37:02,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a7b4bb0 >2014-01-30 04:37:03,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2a7b4bb0 >2014-01-30 04:37:03,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e5733e >2014-01-30 04:37:03,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9848390a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@160e2a4}, log id: 7e5733e >2014-01-30 04:37:08,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b678959 >2014-01-30 04:37:09,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: b678959 >2014-01-30 04:37:09,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3588b152 >2014-01-30 04:37:09,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b02824f0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7705a352}, log id: 3588b152 >2014-01-30 04:37:14,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7990705d >2014-01-30 04:37:14,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7990705d >2014-01-30 04:37:14,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 669ad6cf >2014-01-30 04:37:15,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d5cfc31, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b00a74c}, log id: 669ad6cf >2014-01-30 04:37:20,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1465aa05 >2014-01-30 04:37:20,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1465aa05 >2014-01-30 04:37:20,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f882502 >2014-01-30 04:37:21,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@351598d6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19d43107}, log id: 7f882502 >2014-01-30 04:37:26,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 533c09df >2014-01-30 04:37:26,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 533c09df >2014-01-30 04:37:26,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26e274ac >2014-01-30 04:37:26,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e92e8842, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f47b37f4}, log id: 26e274ac >2014-01-30 04:37:31,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b74c248 >2014-01-30 04:37:32,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3b74c248 >2014-01-30 04:37:32,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25a02785 >2014-01-30 04:37:32,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@470a6fc9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a47aaaf}, log id: 25a02785 >2014-01-30 04:37:37,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2009be4d >2014-01-30 04:37:38,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2009be4d >2014-01-30 04:37:38,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2be8ed54 >2014-01-30 04:37:38,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50039e96, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50e504f7}, log id: 2be8ed54 >2014-01-30 04:37:43,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c85758f >2014-01-30 04:37:44,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: c85758f >2014-01-30 04:37:44,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 163f9586 >2014-01-30 04:37:44,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4392a1d5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6804a4b0}, log id: 163f9586 >2014-01-30 04:37:47,715 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-86) [63ec361] No up server in cluster >2014-01-30 04:37:47,715 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-86) [63ec361] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:37:47,719 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-86) [63ec361] No up server in cluster >2014-01-30 04:37:47,719 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-86) [63ec361] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:37:47,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 4464ba1b >2014-01-30 04:37:48,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4464ba1b >2014-01-30 04:37:48,256 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-86) [63ec361] No up server in cluster >2014-01-30 04:37:48,256 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-86) [63ec361] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:37:49,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 531cf61e >2014-01-30 04:37:49,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 531cf61e >2014-01-30 04:37:49,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 525f668e >2014-01-30 04:37:50,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8185ea6d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1b9b17f}, log id: 525f668e >2014-01-30 04:37:55,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e955ed4 >2014-01-30 04:37:55,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6e955ed4 >2014-01-30 04:37:55,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6924536a >2014-01-30 04:37:56,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@635f2b64, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e462e96}, log id: 6924536a >2014-01-30 04:38:01,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21024742 >2014-01-30 04:38:01,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 21024742 >2014-01-30 04:38:01,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c470e82 >2014-01-30 04:38:01,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2751ee25, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e1d005c}, log id: c470e82 >2014-01-30 04:38:06,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 28bc655d >2014-01-30 04:38:07,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 28bc655d >2014-01-30 04:38:07,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e14042b >2014-01-30 04:38:07,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2c7b56c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d376e3d}, log id: 5e14042b >2014-01-30 04:38:12,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 70374120 >2014-01-30 04:38:13,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 70374120 >2014-01-30 04:38:13,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4061c4eb >2014-01-30 04:38:13,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5c13339, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8fc27651}, log id: 4061c4eb >2014-01-30 04:38:18,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5306f374 >2014-01-30 04:38:19,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5306f374 >2014-01-30 04:38:19,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11a3198 >2014-01-30 04:38:19,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@513b7a4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@125c080c}, log id: 11a3198 >2014-01-30 04:38:24,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 718f605f >2014-01-30 04:38:24,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 718f605f >2014-01-30 04:38:24,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 657a3fca >2014-01-30 04:38:25,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9efae158, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49f15fc8}, log id: 657a3fca >2014-01-30 04:38:30,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4da3ec0a >2014-01-30 04:38:30,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4da3ec0a >2014-01-30 04:38:30,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b4ee463 >2014-01-30 04:38:30,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37d19b82, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@230df9b3}, log id: b4ee463 >2014-01-30 04:38:36,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c37d8cf >2014-01-30 04:38:36,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7c37d8cf >2014-01-30 04:38:36,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7fa0fcfb >2014-01-30 04:38:36,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b6f060c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86c49449}, log id: 7fa0fcfb >2014-01-30 04:38:41,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64fa0a9 >2014-01-30 04:38:42,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 64fa0a9 >2014-01-30 04:38:42,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4126cccd >2014-01-30 04:38:42,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b554d94, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f48d3a68}, log id: 4126cccd >2014-01-30 04:38:47,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a3a99f4 >2014-01-30 04:38:48,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4a3a99f4 >2014-01-30 04:38:48,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b90d62a >2014-01-30 04:38:48,263 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-36) [359e3b48] No up server in cluster >2014-01-30 04:38:48,263 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-36) [359e3b48] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:38:48,266 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-36) [359e3b48] No up server in cluster >2014-01-30 04:38:48,266 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-36) [359e3b48] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:38:48,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 5222328e >2014-01-30 04:38:48,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c806740, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6abb29fd}, log id: 3b90d62a >2014-01-30 04:38:48,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 5222328e >2014-01-30 04:38:48,825 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-36) [359e3b48] No up server in cluster >2014-01-30 04:38:48,825 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-36) [359e3b48] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:38:53,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 798ceb81 >2014-01-30 04:38:53,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 798ceb81 >2014-01-30 04:38:53,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 990d396 >2014-01-30 04:38:54,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e49f9751, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b588a5e}, log id: 990d396 >2014-01-30 04:38:59,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1330262f >2014-01-30 04:38:59,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1330262f >2014-01-30 04:38:59,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 561073e >2014-01-30 04:38:59,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3dd74b12, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbdfe49e}, log id: 561073e >2014-01-30 04:39:05,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 385a33d1 >2014-01-30 04:39:05,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 385a33d1 >2014-01-30 04:39:05,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 507855a1 >2014-01-30 04:39:05,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5d771be, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f677c1c}, log id: 507855a1 >2014-01-30 04:39:10,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a5b3fb9 >2014-01-30 04:39:11,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7a5b3fb9 >2014-01-30 04:39:11,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11c49313 >2014-01-30 04:39:11,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e4f14a9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f552011}, log id: 11c49313 >2014-01-30 04:39:16,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c471e51 >2014-01-30 04:39:17,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c471e51 >2014-01-30 04:39:17,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 274a1ff >2014-01-30 04:39:17,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb960a2e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb3c871f}, log id: 274a1ff >2014-01-30 04:39:22,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e46cf97 >2014-01-30 04:39:22,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3e46cf97 >2014-01-30 04:39:22,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e24ecd7 >2014-01-30 04:39:23,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f0399d1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84a34a0a}, log id: 5e24ecd7 >2014-01-30 04:39:28,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38e503c9 >2014-01-30 04:39:28,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 38e503c9 >2014-01-30 04:39:28,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c6c5314 >2014-01-30 04:39:29,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@250e8709, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@320bdc7c}, log id: 3c6c5314 >2014-01-30 04:39:34,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13c69bce >2014-01-30 04:39:34,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 13c69bce >2014-01-30 04:39:34,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ffe224f >2014-01-30 04:39:34,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@156871cf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84110d7f}, log id: 5ffe224f >2014-01-30 04:39:39,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a4fe001 >2014-01-30 04:39:40,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4a4fe001 >2014-01-30 04:39:40,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d2edbe7 >2014-01-30 04:39:40,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d02af7d0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@705abe2d}, log id: 6d2edbe7 >2014-01-30 04:39:45,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22b6f48d >2014-01-30 04:39:46,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 22b6f48d >2014-01-30 04:39:46,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ed685c4 >2014-01-30 04:39:46,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc7f4c15, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a45919c}, log id: 2ed685c4 >2014-01-30 04:39:48,833 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] No up server in cluster >2014-01-30 04:39:48,834 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:39:48,837 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] No up server in cluster >2014-01-30 04:39:48,837 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:39:48,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5fd02287 >2014-01-30 04:39:49,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 67a0f52a >2014-01-30 04:39:49,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2619b307, log id: 67a0f52a >2014-01-30 04:39:49,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 6138a41b >2014-01-30 04:39:49,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 5fd02287 >2014-01-30 04:39:49,376 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] No up server in cluster >2014-01-30 04:39:49,376 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:39:49,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@5dad1716, log id: 6138a41b >2014-01-30 04:39:51,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10455189 >2014-01-30 04:39:51,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 10455189 >2014-01-30 04:39:52,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 28af1b02 >2014-01-30 04:39:52,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@760d0cdd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eba58ade}, log id: 28af1b02 >2014-01-30 04:39:57,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6873a153 >2014-01-30 04:39:57,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6873a153 >2014-01-30 04:39:57,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e1ceb3 >2014-01-30 04:39:58,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7818787c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fe16b65}, log id: 2e1ceb3 >2014-01-30 04:40:03,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 321fd9b1 >2014-01-30 04:40:03,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 321fd9b1 >2014-01-30 04:40:03,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e4ef11 >2014-01-30 04:40:03,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7eb18fc8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c12355e2}, log id: 5e4ef11 >2014-01-30 04:40:08,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6df72090 >2014-01-30 04:40:09,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6df72090 >2014-01-30 04:40:09,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10d5c6ca >2014-01-30 04:40:09,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d4a235e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78c32681}, log id: 10d5c6ca >2014-01-30 04:40:14,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 462c4016 >2014-01-30 04:40:15,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 462c4016 >2014-01-30 04:40:15,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32de90da >2014-01-30 04:40:15,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51989fcc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9316c5fb}, log id: 32de90da >2014-01-30 04:40:20,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 463f1a6f >2014-01-30 04:40:21,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 463f1a6f >2014-01-30 04:40:21,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69083a7 >2014-01-30 04:40:21,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7cb21f7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7aa0c5a3}, log id: 69083a7 >2014-01-30 04:40:26,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3336efe1 >2014-01-30 04:40:26,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3336efe1 >2014-01-30 04:40:26,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1713bc11 >2014-01-30 04:40:27,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bb1ab15, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d550997}, log id: 1713bc11 >2014-01-30 04:40:32,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 279d88df >2014-01-30 04:40:32,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 279d88df >2014-01-30 04:40:32,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 61a7d7e6 >2014-01-30 04:40:33,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b1d76ff, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33493b21}, log id: 61a7d7e6 >2014-01-30 04:40:38,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d8ca8fd >2014-01-30 04:40:38,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: d8ca8fd >2014-01-30 04:40:38,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b1792c0 >2014-01-30 04:40:38,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3d33473, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22d268ad}, log id: b1792c0 >2014-01-30 04:40:43,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 62dde289 >2014-01-30 04:40:44,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 62dde289 >2014-01-30 04:40:44,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e48e9a2 >2014-01-30 04:40:44,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b397d39b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f88491d}, log id: e48e9a2 >2014-01-30 04:40:49,383 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) [69d5f07e] No up server in cluster >2014-01-30 04:40:49,383 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) [69d5f07e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:40:49,387 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) [69d5f07e] No up server in cluster >2014-01-30 04:40:49,387 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) [69d5f07e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:40:49,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 3ecd00f1 >2014-01-30 04:40:49,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c2a38dd >2014-01-30 04:40:49,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 3ecd00f1 >2014-01-30 04:40:49,927 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-67) [69d5f07e] No up server in cluster >2014-01-30 04:40:49,928 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-67) [69d5f07e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:40:50,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4c2a38dd >2014-01-30 04:40:50,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15428098 >2014-01-30 04:40:50,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@111b0683, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de5520f4}, log id: 15428098 >2014-01-30 04:40:55,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26846a14 >2014-01-30 04:40:55,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 26846a14 >2014-01-30 04:40:55,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3524c968 >2014-01-30 04:40:56,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec711aa9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1764bf0d}, log id: 3524c968 >2014-01-30 04:41:01,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b5bb9cf >2014-01-30 04:41:01,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2b5bb9cf >2014-01-30 04:41:01,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a16884c >2014-01-30 04:41:02,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f84f728d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4e2474d}, log id: 4a16884c >2014-01-30 04:41:07,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 741c46da >2014-01-30 04:41:07,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 741c46da >2014-01-30 04:41:07,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12ce8bbf >2014-01-30 04:41:07,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69c2d0c3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f22daba}, log id: 12ce8bbf >2014-01-30 04:41:12,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 310d92c3 >2014-01-30 04:41:13,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 310d92c3 >2014-01-30 04:41:13,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13add2cd >2014-01-30 04:41:13,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89c5d5c8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e404601c}, log id: 13add2cd >2014-01-30 04:41:18,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 315e5a78 >2014-01-30 04:41:19,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 315e5a78 >2014-01-30 04:41:19,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ba2af38 >2014-01-30 04:41:19,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0689fc8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89f25437}, log id: 2ba2af38 >2014-01-30 04:41:24,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49d95a60 >2014-01-30 04:41:25,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 49d95a60 >2014-01-30 04:41:25,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 108ae23b >2014-01-30 04:41:25,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b576255a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87515e0b}, log id: 108ae23b >2014-01-30 04:41:27,002 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-8) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:41:27,219 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-2) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:41:30,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ebc8212 >2014-01-30 04:41:30,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4ebc8212 >2014-01-30 04:41:30,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2772a2e9 >2014-01-30 04:41:31,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8204bf89, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@438d30b3}, log id: 2772a2e9 >2014-01-30 04:41:36,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 75aac299 >2014-01-30 04:41:36,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 75aac299 >2014-01-30 04:41:36,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7003df97 >2014-01-30 04:41:36,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6410790, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de7d57ad}, log id: 7003df97 >2014-01-30 04:41:42,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f1d9505 >2014-01-30 04:41:42,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4f1d9505 >2014-01-30 04:41:42,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 102fad17 >2014-01-30 04:41:42,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96f42def, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f23d96b0}, log id: 102fad17 >2014-01-30 04:41:47,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 177c4d53 >2014-01-30 04:41:48,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 177c4d53 >2014-01-30 04:41:48,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68fdfeb6 >2014-01-30 04:41:48,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7549f4c1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f006167}, log id: 68fdfeb6 >2014-01-30 04:41:49,935 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2014-01-30 04:41:49,935 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:41:49,939 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2014-01-30 04:41:49,939 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:41:49,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 46e5425d >2014-01-30 04:41:50,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 46e5425d >2014-01-30 04:41:50,504 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2014-01-30 04:41:50,505 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:41:53,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 518b6017 >2014-01-30 04:41:54,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 518b6017 >2014-01-30 04:41:54,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31e9481c >2014-01-30 04:41:54,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43ecf886, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f0f459f}, log id: 31e9481c >2014-01-30 04:41:59,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ba37b44 >2014-01-30 04:41:59,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2ba37b44 >2014-01-30 04:41:59,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e9747a9 >2014-01-30 04:42:00,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3afc0ba9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b87cfb1}, log id: 6e9747a9 >2014-01-30 04:42:05,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 383c0542 >2014-01-30 04:42:05,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 383c0542 >2014-01-30 04:42:05,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 176a3678 >2014-01-30 04:42:06,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5628c9c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8dd9c00e}, log id: 176a3678 >2014-01-30 04:42:11,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ab761ea >2014-01-30 04:42:11,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: ab761ea >2014-01-30 04:42:11,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: af4997a >2014-01-30 04:42:11,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23680e25, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63af57b6}, log id: af4997a >2014-01-30 04:42:16,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3bf3b922 >2014-01-30 04:42:17,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3bf3b922 >2014-01-30 04:42:17,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 706130c3 >2014-01-30 04:42:17,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c4084b3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61f59d9d}, log id: 706130c3 >2014-01-30 04:42:22,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59ca63f1 >2014-01-30 04:42:23,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 59ca63f1 >2014-01-30 04:42:23,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21769fba >2014-01-30 04:42:23,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@239d2071, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23940f9d}, log id: 21769fba >2014-01-30 04:42:28,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3498d4d8 >2014-01-30 04:42:29,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3498d4d8 >2014-01-30 04:42:29,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35a6892f >2014-01-30 04:42:29,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db5ce8b4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d93fe4aa}, log id: 35a6892f >2014-01-30 04:42:33,196 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-74) [61851da7] Start refreshing all users data >2014-01-30 04:42:33,252 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-26) [7a78e8e] Attempting to update VMs/Templates Ovf. >2014-01-30 04:42:34,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71176b43 >2014-01-30 04:42:34,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-19) [1d6d6076] START, GlusterHooksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 70e48956 >2014-01-30 04:42:34,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-38) [1d6d6076] START, GlusterHooksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 1e093e79 >2014-01-30 04:42:34,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-46) [1d6d6076] START, GlusterHooksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 2bf4a701 >2014-01-30 04:42:34,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-47) [1d6d6076] START, GlusterHooksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 583cc3c >2014-01-30 04:42:34,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-38) [1d6d6076] FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@e6d5c03e, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@c93bb6b4, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@8a38c8a, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@6330c8f9, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b7ef72fb, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@af9de0cb, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@afd78bb0, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b0fb1d8d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@dbf47ff6, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@845f6b34, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@2efd9e32, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@e6d05d6d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@159f7c6a], log id: 1e093e79 >2014-01-30 04:42:34,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-46) [1d6d6076] FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f757c1a8, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@4a0280ae, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@48badea9, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@1c49343c, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@56ef6c56, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@2aebb4c1, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b6541f78, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@ba2df611, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@bd0b084c, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f616c83f, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@bef6be4b, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f03d3d48, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@d82c20c3], log id: 2bf4a701 >2014-01-30 04:42:34,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-19) [1d6d6076] FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f0e6eb66, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@1b5a0133, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@114770b1, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@eda711d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b3dfe953, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@15dee953, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@5bf67e17, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@ead65cc0, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@4e72fb2c, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@5d383be7, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@1918efc6, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@3f290ee3, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b2d89fef], log id: 70e48956 >2014-01-30 04:42:34,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-47) [1d6d6076] FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@7f38fe72, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@9d535d27, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@13723e35, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@854d3585, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@329f40cd, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@9914bd2c, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@7b84fa50, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@3513625a, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@2705e48d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@d5359202, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@daa3cd5e, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@796815dd, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@36a318d8], log id: 583cc3c >2014-01-30 04:42:34,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 71176b43 >2014-01-30 04:42:34,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 270662eb >2014-01-30 04:42:35,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f65e5da7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f55380f4}, log id: 270662eb >2014-01-30 04:42:35,895 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-4) [2a2ae7e1] Running command: LogoutUserCommand internal: false. >2014-01-30 04:42:35,902 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-4) [2a2ae7e1] Correlation ID: 2a2ae7e1, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged out. >2014-01-30 04:42:40,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5de52cef >2014-01-30 04:42:40,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5de52cef >2014-01-30 04:42:40,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5143dfe9 >2014-01-30 04:42:41,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fa2de03, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69e2e2c6}, log id: 5143dfe9 >2014-01-30 04:42:46,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 45b42aa5 >2014-01-30 04:42:46,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 45b42aa5 >2014-01-30 04:42:46,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 208ba106 >2014-01-30 04:42:46,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@614ad231, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea0c761a}, log id: 208ba106 >2014-01-30 04:42:50,514 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-68) No up server in cluster >2014-01-30 04:42:50,514 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-68) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:42:50,518 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-68) No up server in cluster >2014-01-30 04:42:50,518 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-68) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:42:50,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c015b7 >2014-01-30 04:42:51,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: c015b7 >2014-01-30 04:42:51,082 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-68) No up server in cluster >2014-01-30 04:42:51,083 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-68) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:42:51,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1be5492d >2014-01-30 04:42:52,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1be5492d >2014-01-30 04:42:52,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7026c1a0 >2014-01-30 04:42:52,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b26b93be, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f0efe98}, log id: 7026c1a0 >2014-01-30 04:42:57,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18475593 >2014-01-30 04:42:58,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 18475593 >2014-01-30 04:42:58,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1bbe944b >2014-01-30 04:42:58,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41910364, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c8aa0d}, log id: 1bbe944b >2014-01-30 04:43:03,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b2359b0 >2014-01-30 04:43:04,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: b2359b0 >2014-01-30 04:43:04,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16e90c2f >2014-01-30 04:43:04,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dde909cd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bd83517}, log id: 16e90c2f >2014-01-30 04:43:09,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6fed91ee >2014-01-30 04:43:09,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6fed91ee >2014-01-30 04:43:09,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60e6c550 >2014-01-30 04:43:10,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93f7b228, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22d94c3a}, log id: 60e6c550 >2014-01-30 04:43:15,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43b340d9 >2014-01-30 04:43:15,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43b340d9 >2014-01-30 04:43:15,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2646f973 >2014-01-30 04:43:15,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93619ddd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4fda3f4}, log id: 2646f973 >2014-01-30 04:43:20,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7418fd5 >2014-01-30 04:43:21,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7418fd5 >2014-01-30 04:43:21,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3413dd59 >2014-01-30 04:43:21,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c04356df, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ef038ae}, log id: 3413dd59 >2014-01-30 04:43:26,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3efe8eb0 >2014-01-30 04:43:27,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3efe8eb0 >2014-01-30 04:43:27,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4729dbdb >2014-01-30 04:43:27,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b77c8b5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b5f0480}, log id: 4729dbdb >2014-01-30 04:43:32,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e3e8420 >2014-01-30 04:43:33,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6e3e8420 >2014-01-30 04:43:33,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69befdc4 >2014-01-30 04:43:33,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea2531b4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c002b01}, log id: 69befdc4 >2014-01-30 04:43:38,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5653243f >2014-01-30 04:43:39,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5653243f >2014-01-30 04:43:39,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b2351d2 >2014-01-30 04:43:39,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de88c4d5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4bb6f686}, log id: 5b2351d2 >2014-01-30 04:43:44,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d8e2ae6 >2014-01-30 04:43:44,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7d8e2ae6 >2014-01-30 04:43:44,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29616016 >2014-01-30 04:43:45,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfdc8117, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2cfc03d7}, log id: 29616016 >2014-01-30 04:43:50,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25e6f0a9 >2014-01-30 04:43:50,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 25e6f0a9 >2014-01-30 04:43:50,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50ce6c13 >2014-01-30 04:43:50,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10d625a9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7813476a}, log id: 50ce6c13 >2014-01-30 04:43:51,090 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) [78fb20d6] No up server in cluster >2014-01-30 04:43:51,091 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) [78fb20d6] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:43:51,094 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) [78fb20d6] No up server in cluster >2014-01-30 04:43:51,094 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) [78fb20d6] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:43:51,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 4302a464 >2014-01-30 04:43:51,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4302a464 >2014-01-30 04:43:51,658 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) [78fb20d6] No up server in cluster >2014-01-30 04:43:51,658 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) [78fb20d6] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:43:55,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3eaf3b1f >2014-01-30 04:43:56,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3eaf3b1f >2014-01-30 04:43:56,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52249479 >2014-01-30 04:43:56,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e52148af, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7165501}, log id: 52249479 >2014-01-30 04:44:01,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2dc8ddcc >2014-01-30 04:44:02,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2dc8ddcc >2014-01-30 04:44:02,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60a5714f >2014-01-30 04:44:02,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d463b29, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8744ebc}, log id: 60a5714f >2014-01-30 04:44:07,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 768a0 >2014-01-30 04:44:08,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 768a0 >2014-01-30 04:44:08,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e7f8131 >2014-01-30 04:44:08,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@551c076c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c149aa0d}, log id: 2e7f8131 >2014-01-30 04:44:13,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41934d52 >2014-01-30 04:44:13,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 41934d52 >2014-01-30 04:44:13,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58dd4c72 >2014-01-30 04:44:14,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1cb894d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72045b30}, log id: 58dd4c72 >2014-01-30 04:44:19,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d81c3ac >2014-01-30 04:44:19,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3d81c3ac >2014-01-30 04:44:19,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4557c183 >2014-01-30 04:44:20,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d2c75eb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a80218cd}, log id: 4557c183 >2014-01-30 04:44:25,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12c5aa76 >2014-01-30 04:44:25,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 12c5aa76 >2014-01-30 04:44:25,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1753127d >2014-01-30 04:44:25,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8284cca, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e90e52}, log id: 1753127d >2014-01-30 04:44:30,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7133b813 >2014-01-30 04:44:31,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7133b813 >2014-01-30 04:44:31,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13bc0b68 >2014-01-30 04:44:31,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31504945, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f119baa5}, log id: 13bc0b68 >2014-01-30 04:44:36,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e692406 >2014-01-30 04:44:37,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3e692406 >2014-01-30 04:44:37,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71c35fdc >2014-01-30 04:44:37,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2359b975, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ddc04aae}, log id: 71c35fdc >2014-01-30 04:44:42,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 789b3ab5 >2014-01-30 04:44:43,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 789b3ab5 >2014-01-30 04:44:43,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e7dc89f >2014-01-30 04:44:43,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e92ca3f5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1834b00}, log id: 6e7dc89f >2014-01-30 04:44:48,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b3f6ee9 >2014-01-30 04:44:48,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: b3f6ee9 >2014-01-30 04:44:48,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10f60e20 >2014-01-30 04:44:49,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d965938, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8799868c}, log id: 10f60e20 >2014-01-30 04:44:49,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 2f8544fa >2014-01-30 04:44:49,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@361da813, log id: 2f8544fa >2014-01-30 04:44:49,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 55059326 >2014-01-30 04:44:50,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@30344940, log id: 55059326 >2014-01-30 04:44:51,666 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-54) [2214a5ea] No up server in cluster >2014-01-30 04:44:51,666 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:44:51,669 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-54) [2214a5ea] No up server in cluster >2014-01-30 04:44:51,669 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:44:51,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 1366f4e1 >2014-01-30 04:44:52,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 1366f4e1 >2014-01-30 04:44:52,272 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-54) [2214a5ea] No up server in cluster >2014-01-30 04:44:52,272 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:44:54,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a0a6be5 >2014-01-30 04:44:54,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6a0a6be5 >2014-01-30 04:44:54,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b832b9c >2014-01-30 04:44:54,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3ee0551, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@241e90f5}, log id: 6b832b9c >2014-01-30 04:44:59,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a4bf8d0 >2014-01-30 04:45:00,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4a4bf8d0 >2014-01-30 04:45:00,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4209ee05 >2014-01-30 04:45:00,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd1195f7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a5d1e05}, log id: 4209ee05 >2014-01-30 04:45:05,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60646d1e >2014-01-30 04:45:06,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 60646d1e >2014-01-30 04:45:06,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d573bfb >2014-01-30 04:45:06,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@904e05be, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66467afe}, log id: 3d573bfb >2014-01-30 04:45:11,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b4accfc >2014-01-30 04:45:12,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7b4accfc >2014-01-30 04:45:12,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25895c2d >2014-01-30 04:45:12,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a240198, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@817bc5f0}, log id: 25895c2d >2014-01-30 04:45:17,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1eec3ba8 >2014-01-30 04:45:17,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1eec3ba8 >2014-01-30 04:45:17,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3996a695 >2014-01-30 04:45:18,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1df5c17b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae779db2}, log id: 3996a695 >2014-01-30 04:45:23,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 219bbb0b >2014-01-30 04:45:23,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 219bbb0b >2014-01-30 04:45:23,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1fca2e2 >2014-01-30 04:45:23,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@769d89df, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dce2b165}, log id: 1fca2e2 >2014-01-30 04:45:29,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77f82309 >2014-01-30 04:45:29,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 77f82309 >2014-01-30 04:45:29,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e19e00d >2014-01-30 04:45:29,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e455232b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73fd180d}, log id: 3e19e00d >2014-01-30 04:45:34,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 576bdc23 >2014-01-30 04:45:35,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 576bdc23 >2014-01-30 04:45:35,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d282356 >2014-01-30 04:45:35,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3eb18b16, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7cb24543}, log id: 1d282356 >2014-01-30 04:45:40,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 699fc6b0 >2014-01-30 04:45:41,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 699fc6b0 >2014-01-30 04:45:41,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e2e452 >2014-01-30 04:45:41,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@310f6517, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d557d7a6}, log id: 1e2e452 >2014-01-30 04:45:46,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74cf6a31 >2014-01-30 04:45:46,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 74cf6a31 >2014-01-30 04:45:46,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f73d2cf >2014-01-30 04:45:47,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19ab3a38, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71b6a7cc}, log id: f73d2cf >2014-01-30 04:45:52,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5afcf36e >2014-01-30 04:45:52,281 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) [213c04fd] No up server in cluster >2014-01-30 04:45:52,281 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) [213c04fd] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:45:52,284 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) [213c04fd] No up server in cluster >2014-01-30 04:45:52,285 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) [213c04fd] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:45:52,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7dbc6d56 >2014-01-30 04:45:52,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5afcf36e >2014-01-30 04:45:52,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d380429 >2014-01-30 04:45:52,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 7dbc6d56 >2014-01-30 04:45:52,806 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) [213c04fd] No up server in cluster >2014-01-30 04:45:52,806 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) [213c04fd] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:45:53,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b782851e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d41c3a47}, log id: 2d380429 >2014-01-30 04:45:58,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14cb934d >2014-01-30 04:45:58,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 14cb934d >2014-01-30 04:45:58,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27c84b7a >2014-01-30 04:45:58,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b5547bb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a5def4f}, log id: 27c84b7a >2014-01-30 04:46:03,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2703ffb0 >2014-01-30 04:46:04,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2703ffb0 >2014-01-30 04:46:04,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 285a5c6 >2014-01-30 04:46:04,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e0bb14e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c6a1200}, log id: 285a5c6 >2014-01-30 04:46:09,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3582f562 >2014-01-30 04:46:10,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3582f562 >2014-01-30 04:46:10,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 209d390 >2014-01-30 04:46:10,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b5700e1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd1a1abd}, log id: 209d390 >2014-01-30 04:46:15,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c84c0ad >2014-01-30 04:46:16,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4c84c0ad >2014-01-30 04:46:16,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d666011 >2014-01-30 04:46:16,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb70c89d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61be4fbe}, log id: 6d666011 >2014-01-30 04:46:21,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26616215 >2014-01-30 04:46:21,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 26616215 >2014-01-30 04:46:21,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 399fce47 >2014-01-30 04:46:22,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f20c5f3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39cecd45}, log id: 399fce47 >2014-01-30 04:46:27,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6bc4f2c2 >2014-01-30 04:46:27,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6bc4f2c2 >2014-01-30 04:46:27,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e0682d0 >2014-01-30 04:46:27,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c4bcf8a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fd848c5}, log id: e0682d0 >2014-01-30 04:46:32,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 384600ab >2014-01-30 04:46:33,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 384600ab >2014-01-30 04:46:33,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64a29274 >2014-01-30 04:46:33,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58e7734f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@541170a7}, log id: 64a29274 >2014-01-30 04:46:38,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: eefbfc1 >2014-01-30 04:46:39,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: eefbfc1 >2014-01-30 04:46:39,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f271652 >2014-01-30 04:46:39,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1937a298, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19f60ccb}, log id: 3f271652 >2014-01-30 04:46:44,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e4cf9c4 >2014-01-30 04:46:45,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2e4cf9c4 >2014-01-30 04:46:45,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22789f46 >2014-01-30 04:46:45,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d39c117, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e476d8ca}, log id: 22789f46 >2014-01-30 04:46:50,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a06bf7e >2014-01-30 04:46:50,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3a06bf7e >2014-01-30 04:46:50,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ba5be0b >2014-01-30 04:46:51,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a84f2d26, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4117a6cc}, log id: 7ba5be0b >2014-01-30 04:46:52,814 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-5) [5cab3cac] No up server in cluster >2014-01-30 04:46:52,814 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-5) [5cab3cac] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:46:52,817 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-5) [5cab3cac] No up server in cluster >2014-01-30 04:46:52,817 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-5) [5cab3cac] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:46:52,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66c64cfd >2014-01-30 04:46:53,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 66c64cfd >2014-01-30 04:46:53,373 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-5) [5cab3cac] No up server in cluster >2014-01-30 04:46:53,373 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-5) [5cab3cac] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:46:56,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 769ddcc6 >2014-01-30 04:46:56,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 769ddcc6 >2014-01-30 04:46:56,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b999287 >2014-01-30 04:46:56,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bfaee6d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b445518}, log id: 2b999287 >2014-01-30 04:47:02,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3285b213 >2014-01-30 04:47:02,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3285b213 >2014-01-30 04:47:02,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6950736b >2014-01-30 04:47:02,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9211bc81, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@387d859e}, log id: 6950736b >2014-01-30 04:47:07,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 449cad14 >2014-01-30 04:47:08,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 449cad14 >2014-01-30 04:47:08,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29ff4fb3 >2014-01-30 04:47:08,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c81e0d73, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35514e2f}, log id: 29ff4fb3 >2014-01-30 04:47:13,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66c79fbe >2014-01-30 04:47:14,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 66c79fbe >2014-01-30 04:47:14,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40466568 >2014-01-30 04:47:14,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a66c3627, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4f79378}, log id: 40466568 >2014-01-30 04:47:19,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 47ebefda >2014-01-30 04:47:19,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 47ebefda >2014-01-30 04:47:19,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 239e733 >2014-01-30 04:47:20,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40869f46, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15a94341}, log id: 239e733 >2014-01-30 04:47:25,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7783046f >2014-01-30 04:47:25,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7783046f >2014-01-30 04:47:25,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15ba122 >2014-01-30 04:47:25,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4baaeae0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50843163}, log id: 15ba122 >2014-01-30 04:47:31,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37d82495 >2014-01-30 04:47:31,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 37d82495 >2014-01-30 04:47:31,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e01ed72 >2014-01-30 04:47:31,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9f820b3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a77aa9ec}, log id: e01ed72 >2014-01-30 04:47:36,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ea21fba >2014-01-30 04:47:37,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: ea21fba >2014-01-30 04:47:37,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1809b1be >2014-01-30 04:47:37,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5142747e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfd3a1ac}, log id: 1809b1be >2014-01-30 04:47:42,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4873a5f1 >2014-01-30 04:47:43,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4873a5f1 >2014-01-30 04:47:43,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 380fbea7 >2014-01-30 04:47:43,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fe3b8d8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@587f81d3}, log id: 380fbea7 >2014-01-30 04:47:48,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 518565af >2014-01-30 04:47:48,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 518565af >2014-01-30 04:47:49,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a29529c >2014-01-30 04:47:49,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb97d99f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4aedbe84}, log id: 2a29529c >2014-01-30 04:47:53,382 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-82) [4eafa082] No up server in cluster >2014-01-30 04:47:53,382 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-82) [4eafa082] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:47:53,385 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-82) [4eafa082] No up server in cluster >2014-01-30 04:47:53,386 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-82) [4eafa082] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:47:53,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 6c8acc5f >2014-01-30 04:47:53,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 6c8acc5f >2014-01-30 04:47:53,942 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-82) [4eafa082] No up server in cluster >2014-01-30 04:47:53,942 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-82) [4eafa082] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:47:54,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6bce8b4f >2014-01-30 04:47:54,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6bce8b4f >2014-01-30 04:47:54,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78cabacb >2014-01-30 04:47:55,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fd18e0f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d178e8b}, log id: 78cabacb >2014-01-30 04:48:00,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30b841e8 >2014-01-30 04:48:00,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 30b841e8 >2014-01-30 04:48:00,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f37da05 >2014-01-30 04:48:00,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbcf3a9a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d386e7f6}, log id: 2f37da05 >2014-01-30 04:48:05,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48109c42 >2014-01-30 04:48:06,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 48109c42 >2014-01-30 04:48:06,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 476a8997 >2014-01-30 04:48:06,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b69833ad, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73456375}, log id: 476a8997 >2014-01-30 04:48:11,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1fed42b5 >2014-01-30 04:48:12,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1fed42b5 >2014-01-30 04:48:12,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2efcc3e4 >2014-01-30 04:48:12,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e0cfdf5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3f3e823}, log id: 2efcc3e4 >2014-01-30 04:48:17,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1422e14a >2014-01-30 04:48:18,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1422e14a >2014-01-30 04:48:18,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64ffec01 >2014-01-30 04:48:18,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aaeb41dc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60182625}, log id: 64ffec01 >2014-01-30 04:48:23,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e11d90f >2014-01-30 04:48:23,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6e11d90f >2014-01-30 04:48:23,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54e63be5 >2014-01-30 04:48:24,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a171d4e4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8b2b1ed}, log id: 54e63be5 >2014-01-30 04:48:29,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d020d52 >2014-01-30 04:48:29,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4d020d52 >2014-01-30 04:48:29,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 75ccf5f0 >2014-01-30 04:48:29,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@337c505c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@105dddd1}, log id: 75ccf5f0 >2014-01-30 04:48:34,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72e2cdd2 >2014-01-30 04:48:35,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 72e2cdd2 >2014-01-30 04:48:35,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a4117c0 >2014-01-30 04:48:35,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e66f2b58, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7c5d732}, log id: a4117c0 >2014-01-30 04:48:40,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76275006 >2014-01-30 04:48:41,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 76275006 >2014-01-30 04:48:41,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e960885 >2014-01-30 04:48:41,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72edb337, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5cdcffe9}, log id: 7e960885 >2014-01-30 04:48:46,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ff43dad >2014-01-30 04:48:47,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6ff43dad >2014-01-30 04:48:47,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1be132a1 >2014-01-30 04:48:47,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c8609b3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b20107a}, log id: 1be132a1 >2014-01-30 04:48:52,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4dcd4210 >2014-01-30 04:48:52,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4dcd4210 >2014-01-30 04:48:52,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48775e9c >2014-01-30 04:48:53,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f97e1abc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36378b80}, log id: 48775e9c >2014-01-30 04:48:53,950 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) [992a9f] No up server in cluster >2014-01-30 04:48:53,951 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) [992a9f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:48:53,954 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) [992a9f] No up server in cluster >2014-01-30 04:48:53,954 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) [992a9f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:48:53,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 710c0098 >2014-01-30 04:48:54,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 710c0098 >2014-01-30 04:48:54,523 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) [992a9f] No up server in cluster >2014-01-30 04:48:54,523 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) [992a9f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:48:58,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7dcf26b7 >2014-01-30 04:48:58,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7dcf26b7 >2014-01-30 04:48:58,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 366d1653 >2014-01-30 04:48:59,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca1415b8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6d3b9ee}, log id: 366d1653 >2014-01-30 04:49:04,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 95e11a7 >2014-01-30 04:49:04,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 95e11a7 >2014-01-30 04:49:04,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b930842 >2014-01-30 04:49:04,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0f42a6c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61bb9c09}, log id: 2b930842 >2014-01-30 04:49:09,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ff6c9be >2014-01-30 04:49:10,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4ff6c9be >2014-01-30 04:49:10,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: bf6ff52 >2014-01-30 04:49:10,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41757fa0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96186cd4}, log id: bf6ff52 >2014-01-30 04:49:14,373 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-5) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:49:15,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a258554 >2014-01-30 04:49:16,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1a258554 >2014-01-30 04:49:16,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7bf7e400 >2014-01-30 04:49:16,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e123faa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59b20f7d}, log id: 7bf7e400 >2014-01-30 04:49:17,039 INFO [org.ovirt.engine.core.bll.RemoveVdsGroupCommand] (pool-5-thread-47) [5d63a10a] Running command: RemoveVdsGroupCommand internal: false. Entities affected : ID: 0d368adf-557a-4706-9b3a-f6559a752a3f Type: VdsGroups >2014-01-30 04:49:17,071 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-47) [5d63a10a] Correlation ID: 5d63a10a, Call Stack: null, Custom Event ID: -1, Message: Host cluster test_3 was removed by admin@internal >2014-01-30 04:49:18,719 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-1) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:49:20,205 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-8) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:49:20,285 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-9) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:49:20,877 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-2) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:49:21,138 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-4) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:49:21,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 86ba2cb >2014-01-30 04:49:22,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 86ba2cb >2014-01-30 04:49:22,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64a8f48 >2014-01-30 04:49:22,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ffb2c3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7a97b8}, log id: 64a8f48 >2014-01-30 04:49:27,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b475fb4 >2014-01-30 04:49:27,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b475fb4 >2014-01-30 04:49:27,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15d8eabf >2014-01-30 04:49:28,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d33fa829, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3dfc57f2}, log id: 15d8eabf >2014-01-30 04:49:33,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 28cd6ffb >2014-01-30 04:49:33,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 28cd6ffb >2014-01-30 04:49:33,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66a4eede >2014-01-30 04:49:34,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45333f38, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0e6a7f1}, log id: 66a4eede >2014-01-30 04:49:39,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2efa210d >2014-01-30 04:49:39,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2efa210d >2014-01-30 04:49:39,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3bc433ca >2014-01-30 04:49:39,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7127e5c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d11786c}, log id: 3bc433ca >2014-01-30 04:49:44,252 INFO [org.ovirt.engine.core.bll.AddVdsGroupCommand] (ajp-/127.0.0.1:8702-3) [6d66b90a] Running command: AddVdsGroupCommand internal: false. Entities affected : ID: 5849b030-626e-47cb-ad90-3ce782d831b3 Type: StoragePool >2014-01-30 04:49:44,269 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-3) [6d66b90a] Correlation ID: 6d66b90a, Call Stack: null, Custom Event ID: -1, Message: Host cluster test_3 was added by admin@internal >2014-01-30 04:49:44,289 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-5-thread-43) [23c7e70c] Start running CanDoAction for command number 2/2 (Command type: AddVds) >2014-01-30 04:49:44,290 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-5-thread-47) [c64a5e7] Start running CanDoAction for command number 1/2 (Command type: AddVds) >2014-01-30 04:49:44,584 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-5-thread-47) [c64a5e7] Finish handling CanDoAction for command number 1/2 (Command type: AddVds) >2014-01-30 04:49:44,599 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-5-thread-43) [23c7e70c] Finish handling CanDoAction for command number 2/2 (Command type: AddVds) >2014-01-30 04:49:44,629 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (pool-5-thread-43) [c64a5e7] Running command: AddVdsCommand internal: false. Entities affected : ID: f4553d97-d9b7-4ef6-abae-aef9124eff9d Type: VdsGroups >2014-01-30 04:49:44,650 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (pool-5-thread-43) [60c0b213] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 45e42dfd-602d-47ea-ad35-9ee3ce83655e Type: VDS >2014-01-30 04:49:44,658 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (pool-5-thread-43) [60c0b213] Lock freed to object EngineLock [exclusiveLocks= key: 5849b030-626e-47cb-ad90-3ce782d831b3 value: REGISTER_VDS >, sharedLocks= ] >2014-01-30 04:49:44,658 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (pool-5-thread-43) [60c0b213] Cannot get vdsManager for vdsid=45e42dfd-602d-47ea-ad35-9ee3ce83655e >2014-01-30 04:49:44,661 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-43) [60c0b213] START, RemoveVdsVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 12a73e1 >2014-01-30 04:49:44,661 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (pool-5-thread-43) [60c0b213] Cannot get vdsManager for vdsid=45e42dfd-602d-47ea-ad35-9ee3ce83655e >2014-01-30 04:49:44,661 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-43) [60c0b213] FINISH, RemoveVdsVDSCommand, log id: 12a73e1 >2014-01-30 04:49:44,661 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (pool-5-thread-43) [60c0b213] Cannot get vdsManager for vdsid=45e42dfd-602d-47ea-ad35-9ee3ce83655e >2014-01-30 04:49:44,662 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (pool-5-thread-43) [60c0b213] START, AddVdsVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 17037190 >2014-01-30 04:49:44,662 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (pool-5-thread-43) [60c0b213] AddVds - entered , starting logic to add VDS 45e42dfd-602d-47ea-ad35-9ee3ce83655e >2014-01-30 04:49:44,664 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (pool-5-thread-43) [60c0b213] AddVds - VDS 45e42dfd-602d-47ea-ad35-9ee3ce83655e was added, will try to add it to the resource manager >2014-01-30 04:49:44,664 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-5-thread-43) [60c0b213] Entered VdsManager constructor >2014-01-30 04:49:44,679 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-5-thread-43) [60c0b213] Initialize vdsBroker (10.70.37.158,54,321) >2014-01-30 04:49:44,682 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (pool-5-thread-43) [60c0b213] VDS 45e42dfd-602d-47ea-ad35-9ee3ce83655e was added to the Resource Manager >2014-01-30 04:49:44,682 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (pool-5-thread-43) [60c0b213] FINISH, AddVdsVDSCommand, log id: 17037190 >2014-01-30 04:49:44,698 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-47) [7ca40507] Lock Acquired to object EngineLock [exclusiveLocks= key: 45e42dfd-602d-47ea-ad35-9ee3ce83655e value: VDS >, sharedLocks= ] >2014-01-30 04:49:44,700 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-43) [60c0b213] Correlation ID: c64a5e7, Job ID: 5fbbd295-17f0-499d-94fe-4ae237730af4, Call Stack: null, Custom Event ID: -1, Message: Host 10.70.37.158 was added by admin@internal. >2014-01-30 04:49:44,706 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-47) [7ca40507] Running command: InstallVdsCommand internal: true. Entities affected : ID: 45e42dfd-602d-47ea-ad35-9ee3ce83655e Type: VDS >2014-01-30 04:49:44,706 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-47) [7ca40507] Before Installation host 45e42dfd-602d-47ea-ad35-9ee3ce83655e, 10.70.37.158 >2014-01-30 04:49:44,707 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-47) [7ca40507] START, SetVdsStatusVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e, status=Installing, nonOperationalReason=NONE), log id: 35b658fa >2014-01-30 04:49:44,710 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-47) [7ca40507] FINISH, SetVdsStatusVDSCommand, log id: 35b658fa >2014-01-30 04:49:44,726 INFO [org.ovirt.engine.core.bll.AddVdsCommand] (pool-5-thread-43) [23c7e70c] Running command: AddVdsCommand internal: false. Entities affected : ID: f4553d97-d9b7-4ef6-abae-aef9124eff9d Type: VdsGroups >2014-01-30 04:49:44,739 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (pool-5-thread-43) [4b4c39b2] Running command: AddVdsSpmIdCommand internal: true. Entities affected : ID: 93ecedfe-3409-43cf-a0b2-b2247948eb75 Type: VDS >2014-01-30 04:49:44,742 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (pool-5-thread-43) [4b4c39b2] Lock freed to object EngineLock [exclusiveLocks= key: 5849b030-626e-47cb-ad90-3ce782d831b3 value: REGISTER_VDS >, sharedLocks= ] >2014-01-30 04:49:44,743 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (pool-5-thread-43) [4b4c39b2] Cannot get vdsManager for vdsid=93ecedfe-3409-43cf-a0b2-b2247948eb75 >2014-01-30 04:49:44,745 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-43) [4b4c39b2] START, RemoveVdsVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 26826b2a >2014-01-30 04:49:44,745 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (pool-5-thread-43) [4b4c39b2] Cannot get vdsManager for vdsid=93ecedfe-3409-43cf-a0b2-b2247948eb75 >2014-01-30 04:49:44,745 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-43) [4b4c39b2] FINISH, RemoveVdsVDSCommand, log id: 26826b2a >2014-01-30 04:49:44,745 ERROR [org.ovirt.engine.core.vdsbroker.ResourceManager] (pool-5-thread-43) [4b4c39b2] Cannot get vdsManager for vdsid=93ecedfe-3409-43cf-a0b2-b2247948eb75 >2014-01-30 04:49:44,746 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (pool-5-thread-43) [4b4c39b2] START, AddVdsVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 48c71d87 >2014-01-30 04:49:44,746 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (pool-5-thread-43) [4b4c39b2] AddVds - entered , starting logic to add VDS 93ecedfe-3409-43cf-a0b2-b2247948eb75 >2014-01-30 04:49:44,747 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (pool-5-thread-43) [4b4c39b2] AddVds - VDS 93ecedfe-3409-43cf-a0b2-b2247948eb75 was added, will try to add it to the resource manager >2014-01-30 04:49:44,747 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-5-thread-43) [4b4c39b2] Entered VdsManager constructor >2014-01-30 04:49:44,757 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-5-thread-43) [4b4c39b2] Initialize vdsBroker (host1,54,321) >2014-01-30 04:49:44,758 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager] (pool-5-thread-43) [4b4c39b2] VDS 93ecedfe-3409-43cf-a0b2-b2247948eb75 was added to the Resource Manager >2014-01-30 04:49:44,758 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand] (pool-5-thread-43) [4b4c39b2] FINISH, AddVdsVDSCommand, log id: 48c71d87 >2014-01-30 04:49:44,768 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-40) [524af277] Lock Acquired to object EngineLock [exclusiveLocks= key: 93ecedfe-3409-43cf-a0b2-b2247948eb75 value: VDS >, sharedLocks= ] >2014-01-30 04:49:44,770 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-43) [4b4c39b2] Correlation ID: 23c7e70c, Job ID: 21a00d5f-5ae1-43c7-accd-3186fafe6040, Call Stack: null, Custom Event ID: -1, Message: Host host1 was added by admin@internal. >2014-01-30 04:49:44,773 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-40) [524af277] Running command: InstallVdsCommand internal: true. Entities affected : ID: 93ecedfe-3409-43cf-a0b2-b2247948eb75 Type: VDS >2014-01-30 04:49:44,773 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-40) [524af277] Before Installation host 93ecedfe-3409-43cf-a0b2-b2247948eb75, host1 >2014-01-30 04:49:44,775 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-40) [524af277] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75, status=Installing, nonOperationalReason=NONE), log id: 6862e366 >2014-01-30 04:49:44,779 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-40) [524af277] FINISH, SetVdsStatusVDSCommand, log id: 6862e366 >2014-01-30 04:49:44,787 INFO [org.ovirt.engine.core.bll.InstallerMessages] (pool-5-thread-47) [7ca40507] Installation 10.70.37.158: Connected to host 10.70.37.158 with SSH key fingerprint: 73:1e:02:2b:dc:f7:e9:fd:e5:27:d1:8d:7d:77:93:2b >2014-01-30 04:49:44,809 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-47) [7ca40507] Correlation ID: 7ca40507, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.158. Connected to host 10.70.37.158 with SSH key fingerprint: 73:1e:02:2b:dc:f7:e9:fd:e5:27:d1:8d:7d:77:93:2b. >2014-01-30 04:49:44,833 INFO [org.ovirt.engine.core.bll.VdsDeploy] (pool-5-thread-47) [7ca40507] Installation of 10.70.37.158. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-01-30 04:49:44,842 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-5-thread-47) SSH execute root@10.70.37.158 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-01-30 04:49:44,866 INFO [org.ovirt.engine.core.bll.InstallerMessages] (pool-5-thread-40) [524af277] Installation host1: Connected to host host1 with SSH key fingerprint: a5:c8:7c:b7:40:4f:92:45:9b:86:04:47:25:44:ed:3f >2014-01-30 04:49:44,874 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-40) [524af277] Correlation ID: 524af277, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Connected to host host1 with SSH key fingerprint: a5:c8:7c:b7:40:4f:92:45:9b:86:04:47:25:44:ed:3f. >2014-01-30 04:49:44,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 728ba6ba >2014-01-30 04:49:44,916 INFO [org.ovirt.engine.core.bll.VdsDeploy] (pool-5-thread-40) [524af277] Installation of host1. Executing command via SSH umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True < /var/cache/ovirt-engine/ovirt-host-deploy.tar >2014-01-30 04:49:44,916 INFO [org.ovirt.engine.core.utils.ssh.SSHDialog] (pool-5-thread-40) SSH execute root@host1 'umask 0077; MYTMP="$(mktemp -t ovirt-XXXXXXXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; rm -fr "${MYTMP}" && mkdir "${MYTMP}" && tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/setup DIALOG/dialect=str:machine DIALOG/customization=bool:True' >2014-01-30 04:49:45,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 728ba6ba >2014-01-30 04:49:45,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64b12ff2 >2014-01-30 04:49:45,406 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.158: Stage: Initializing >2014-01-30 04:49:45,415 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ca40507, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.158. Stage: Initializing. >2014-01-30 04:49:45,434 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.158: Stage: Environment setup >2014-01-30 04:49:45,442 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ca40507, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.158. Stage: Environment setup. >2014-01-30 04:49:45,450 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.158: Stage: Environment packages setup >2014-01-30 04:49:45,458 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ca40507, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.158. Stage: Environment packages setup. >2014-01-30 04:49:45,498 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Initializing >2014-01-30 04:49:45,507 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 524af277, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Initializing. >2014-01-30 04:49:45,524 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Environment setup >2014-01-30 04:49:45,532 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 524af277, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Environment setup. >2014-01-30 04:49:45,540 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Environment packages setup >2014-01-30 04:49:45,548 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 524af277, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Environment packages setup. >2014-01-30 04:49:45,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a29ae6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d062150}, log id: 64b12ff2 >2014-01-30 04:49:46,429 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-7) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:49:46,488 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-9) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 04:49:46,724 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Programs detection >2014-01-30 04:49:46,730 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 524af277, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Programs detection. >2014-01-30 04:49:46,730 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Environment customization >2014-01-30 04:49:46,732 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.158: Stage: Programs detection >2014-01-30 04:49:46,735 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 524af277, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Environment customization. >2014-01-30 04:49:46,737 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ca40507, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.158. Stage: Programs detection. >2014-01-30 04:49:46,737 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.158: Stage: Environment customization >2014-01-30 04:49:46,743 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ca40507, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.158. Stage: Environment customization. >2014-01-30 04:49:46,783 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Logs at host located at: '/tmp/ovirt-host-deploy-20140130044944.log' >2014-01-30 04:49:46,786 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.158: Logs at host located at: '/tmp/ovirt-host-deploy-20140130044944.log' >2014-01-30 04:49:46,793 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 524af277, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Logs at host located at: '/tmp/ovirt-host-deploy-20140130044944.log'. >2014-01-30 04:49:46,795 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ca40507, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.158. Logs at host located at: '/tmp/ovirt-host-deploy-20140130044944.log'. >2014-01-30 04:49:46,844 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host 10.70.37.158 reports unique id 065D83EF-D757-5A47-0FAB-BAF9CDEF5E5D >2014-01-30 04:49:46,845 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Host host1 reports unique id 06DBBCA2-4B43-5948-9A88-7BE15E391E01 >2014-01-30 04:49:46,859 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 065D83EF-D757-5A47-0FAB-BAF9CDEF5E5D to Host 10.70.37.158 >2014-01-30 04:49:46,859 INFO [org.ovirt.engine.core.bll.VdsDeploy] (VdsDeploy) Assigning unique id 06DBBCA2-4B43-5948-9A88-7BE15E391E01 to Host host1 >2014-01-30 04:49:46,992 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.158: Stage: Setup validation >2014-01-30 04:49:46,992 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Setup validation >2014-01-30 04:49:47,000 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 524af277, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Setup validation. >2014-01-30 04:49:47,001 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ca40507, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.158. Stage: Setup validation. >2014-01-30 04:49:47,011 WARN [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.158: Cannot validate host name settings, reason: cannot resolve own name 'rhs.2' >2014-01-30 04:49:47,019 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ca40507, Call Stack: null, Custom Event ID: -1, Message: Host 10.70.37.158 installation in progress . Cannot validate host name settings, reason: cannot resolve own name 'rhs.2'. >2014-01-30 04:49:47,020 WARN [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Cannot validate host name settings, reason: cannot resolve own name 'rhs.1' >2014-01-30 04:49:47,024 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 524af277, Call Stack: null, Custom Event ID: -1, Message: Host host1 installation in progress . Cannot validate host name settings, reason: cannot resolve own name 'rhs.1'. >2014-01-30 04:49:47,245 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.158: Stage: Transaction setup >2014-01-30 04:49:47,250 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ca40507, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.158. Stage: Transaction setup. >2014-01-30 04:49:47,257 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Transaction setup >2014-01-30 04:49:47,261 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 524af277, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Transaction setup. >2014-01-30 04:49:47,290 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.158: Stage: Misc configuration >2014-01-30 04:49:47,295 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ca40507, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.158. Stage: Misc configuration. >2014-01-30 04:49:47,295 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.158: Stage: Package installation >2014-01-30 04:49:47,299 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ca40507, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.158. Stage: Package installation. >2014-01-30 04:49:47,304 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Misc configuration >2014-01-30 04:49:47,308 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 524af277, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Misc configuration. >2014-01-30 04:49:47,308 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Package installation >2014-01-30 04:49:47,312 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 524af277, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Package installation. >2014-01-30 04:49:47,683 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-96) [444c158d] Initializing Host: 10.70.37.158 >2014-01-30 04:49:47,759 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-77) [7c43042] Initializing Host: host1 >2014-01-30 04:49:49,529 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.158: Stage: Misc configuration >2014-01-30 04:49:49,538 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ca40507, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.158. Stage: Misc configuration. >2014-01-30 04:49:49,552 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.158: Setting time >2014-01-30 04:49:49,560 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ca40507, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.158. Setting time. >2014-01-30 04:49:49,673 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Misc configuration >2014-01-30 04:49:49,678 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 524af277, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Misc configuration. >2014-01-30 04:49:49,690 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Setting time >2014-01-30 04:49:49,697 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 524af277, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Setting time. >2014-01-30 04:49:50,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 39ab4e1 >2014-01-30 04:49:50,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@417c5d0f, log id: 39ab4e1 >2014-01-30 04:49:50,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 4bc1a55f >2014-01-30 04:49:50,638 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 04:49:50,686 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 04:49:50,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@52b668ee, log id: 4bc1a55f >2014-01-30 04:49:50,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 45a30bae >2014-01-30 04:49:51,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 45a30bae >2014-01-30 04:49:51,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ba12ea1 >2014-01-30 04:49:51,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d893f9e3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f61a142}, log id: 7ba12ea1 >2014-01-30 04:49:51,762 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.158: Enrolling certificate >2014-01-30 04:49:51,771 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ca40507, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.158. Enrolling certificate. >2014-01-30 04:49:52,834 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.158: Stage: Transaction commit >2014-01-30 04:49:52,840 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ca40507, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.158. Stage: Transaction commit. >2014-01-30 04:49:52,896 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.158: Stage: Closing up >2014-01-30 04:49:52,905 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ca40507, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.158. Stage: Closing up. >2014-01-30 04:49:52,905 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.158: Starting gluster >2014-01-30 04:49:52,912 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ca40507, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.158. Starting gluster. >2014-01-30 04:49:53,019 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Enrolling certificate >2014-01-30 04:49:53,027 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 524af277, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Enrolling certificate. >2014-01-30 04:49:54,086 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Transaction commit >2014-01-30 04:49:54,092 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 524af277, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Transaction commit. >2014-01-30 04:49:54,149 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Closing up >2014-01-30 04:49:54,155 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 524af277, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Closing up. >2014-01-30 04:49:54,155 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Starting gluster >2014-01-30 04:49:54,160 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 524af277, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Starting gluster. >2014-01-30 04:49:54,533 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) [70a1c224] No up server in cluster >2014-01-30 04:49:54,533 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) [70a1c224] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:49:54,537 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) [70a1c224] No up server in cluster >2014-01-30 04:49:54,537 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) [70a1c224] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:49:54,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 757d1839 >2014-01-30 04:49:55,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 757d1839 >2014-01-30 04:49:55,060 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) [70a1c224] No up server in cluster >2014-01-30 04:49:55,060 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) [70a1c224] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:49:56,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26c17a57 >2014-01-30 04:49:56,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 26c17a57 >2014-01-30 04:49:56,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1cdb89a6 >2014-01-30 04:49:57,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19ba792b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3455aa3}, log id: 1cdb89a6 >2014-01-30 04:49:59,340 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.158: Starting vdsm >2014-01-30 04:49:59,349 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ca40507, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.158. Starting vdsm. >2014-01-30 04:50:00,790 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Starting vdsm >2014-01-30 04:50:00,796 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 524af277, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Starting vdsm. >2014-01-30 04:50:02,052 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.158: Stage: Pre-termination >2014-01-30 04:50:02,058 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ca40507, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.158. Stage: Pre-termination. >2014-01-30 04:50:02,083 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.158: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140130045002-10.70.37.158-7ca40507.log' >2014-01-30 04:50:02,088 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ca40507, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.158. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140130045002-10.70.37.158-7ca40507.log'. >2014-01-30 04:50:02,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77fedc66 >2014-01-30 04:50:02,360 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation 10.70.37.158: Stage: Termination >2014-01-30 04:50:02,366 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 7ca40507, Call Stack: null, Custom Event ID: -1, Message: Installing Host 10.70.37.158. Stage: Termination. >2014-01-30 04:50:02,444 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [7ca40507] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:50:02,445 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [7ca40507] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:50:02,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 77fedc66 >2014-01-30 04:50:02,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79877526 >2014-01-30 04:50:02,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8068ffbe, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1920ff}, log id: 79877526 >2014-01-30 04:50:02,964 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [7ca40507] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:50:02,964 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [7ca40507] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:50:03,495 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (pool-5-thread-47) [7ca40507] Engine managed to communicate with VDSM agent on host 10.70.37.158 >2014-01-30 04:50:03,566 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Pre-termination >2014-01-30 04:50:03,571 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 524af277, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Pre-termination. >2014-01-30 04:50:03,591 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140130045003-host1-524af277.log' >2014-01-30 04:50:03,596 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 524af277, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140130045003-host1-524af277.log'. >2014-01-30 04:50:03,784 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (pool-5-thread-47) [38b02c15] Running command: SetupNetworksCommand internal: true. Entities affected : ID: 45e42dfd-602d-47ea-ad35-9ee3ce83655e Type: VDS >2014-01-30 04:50:03,786 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-5-thread-47) [38b02c15] START, SetupNetworksVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e, force=false, checkConnectivity=true, conectivityTimeout=120, > networks=[ovirtmgmt {id=00000000-0000-0000-0000-000000000009, description=Management Network, comment=null, subnet=null, gateway=null, type=null, vlanId=null, stp=false, dataCenterId=5849b030-626e-47cb-ad90-3ce782d831b3, mtu=0, vmNetwork=true, cluster=NetworkCluster {id={clusterId=null, networkId=null}, status=OPERATIONAL, display=false, required=true, migration=false}, providedBy=null, label=null}], > bonds=[], > interfaces=[eth1 {id=0b211cfe-bae2-40f8-ad1e-931017dbbd77, vdsId=45e42dfd-602d-47ea-ad35-9ee3ce83655e, macAddress=52:54:00:f1:6b:70, networkName=null, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=DHCP, address=10.70.37.216, subnet=255.255.254.0, gateway=null, mtu=1500, bridged=false, speed=100, type=0, networkImplementationDetails=null}, > eth0 {id=67cc80bb-4218-43ec-aa6e-4dd9ed661b73, vdsId=45e42dfd-602d-47ea-ad35-9ee3ce83655e, macAddress=52:54:00:32:cd:5f, networkName=ovirtmgmt, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=DHCP, address=10.70.37.158, subnet=255.255.254.0, gateway=null, mtu=1500, bridged=false, speed=0, type=0, networkImplementationDetails=null}], > removedNetworks=[], > removedBonds=[]), log id: e5b0edd >2014-01-30 04:50:03,786 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-5-thread-47) [38b02c15] FINISH, SetupNetworksVDSCommand, log id: e5b0edd >2014-01-30 04:50:03,866 INFO [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation host1: Stage: Termination >2014-01-30 04:50:03,870 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 524af277, Call Stack: null, Custom Event ID: -1, Message: Installing Host host1. Stage: Termination. >2014-01-30 04:50:03,952 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-40) [524af277] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:50:03,952 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-40) [524af277] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:50:04,457 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-40) [524af277] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:50:04,457 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-40) [524af277] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:50:04,989 INFO [org.ovirt.engine.core.bll.network.NetworkConfigurator] (pool-5-thread-40) [524af277] Engine managed to communicate with VDSM agent on host host1 >2014-01-30 04:50:05,284 INFO [org.ovirt.engine.core.bll.network.host.SetupNetworksCommand] (pool-5-thread-40) [1d283775] Running command: SetupNetworksCommand internal: true. Entities affected : ID: 93ecedfe-3409-43cf-a0b2-b2247948eb75 Type: VDS >2014-01-30 04:50:05,286 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-5-thread-40) [1d283775] START, SetupNetworksVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75, force=false, checkConnectivity=true, conectivityTimeout=120, > networks=[ovirtmgmt {id=00000000-0000-0000-0000-000000000009, description=Management Network, comment=null, subnet=null, gateway=null, type=null, vlanId=null, stp=false, dataCenterId=5849b030-626e-47cb-ad90-3ce782d831b3, mtu=0, vmNetwork=true, cluster=NetworkCluster {id={clusterId=null, networkId=null}, status=OPERATIONAL, display=false, required=true, migration=false}, providedBy=null, label=null}], > bonds=[], > interfaces=[eth1 {id=f4f2b969-a1e8-4603-b478-2a80519e76a0, vdsId=93ecedfe-3409-43cf-a0b2-b2247948eb75, macAddress=52:54:00:50:00:cc, networkName=null, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=DHCP, address=10.70.37.149, subnet=255.255.254.0, gateway=null, mtu=1500, bridged=false, speed=100, type=0, networkImplementationDetails=null}, > eth0 {id=34f700b0-6979-467e-8a2a-a22dcc2d7362, vdsId=93ecedfe-3409-43cf-a0b2-b2247948eb75, macAddress=52:54:00:85:81:9e, networkName=ovirtmgmt, vlanId=null, bonded=null, bondName=null, bondOptions=null, bootProtocol=DHCP, address=10.70.37.71, subnet=255.255.254.0, gateway=null, mtu=1500, bridged=false, speed=100, type=0, networkImplementationDetails=null}], > removedNetworks=[], > removedBonds=[]), log id: 3ddb769 >2014-01-30 04:50:05,287 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetupNetworksVDSCommand] (pool-5-thread-40) [1d283775] FINISH, SetupNetworksVDSCommand, log id: 3ddb769 >2014-01-30 04:50:06,297 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [38b02c15] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:50:06,297 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-47) [38b02c15] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:50:07,419 INFO [org.ovirt.engine.core.bll.network.host.CommitNetworkChangesCommand] (pool-5-thread-47) [49bb0a07] Running command: CommitNetworkChangesCommand internal: true. Entities affected : ID: 45e42dfd-602d-47ea-ad35-9ee3ce83655e Type: VDS >2014-01-30 04:50:07,420 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (pool-5-thread-47) [49bb0a07] START, SetSafeNetworkConfigVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2bec032f >2014-01-30 04:50:07,456 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (pool-5-thread-47) [49bb0a07] FINISH, SetSafeNetworkConfigVDSCommand, log id: 2bec032f >2014-01-30 04:50:07,466 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-47) [49bb0a07] Correlation ID: 49bb0a07, Call Stack: null, Custom Event ID: -1, Message: Network changes were saved on host 10.70.37.158 >2014-01-30 04:50:07,469 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-47) [49bb0a07] START, SetVdsStatusVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e, status=Initializing, nonOperationalReason=NONE), log id: 717b456c >2014-01-30 04:50:07,474 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-47) [49bb0a07] FINISH, SetVdsStatusVDSCommand, log id: 717b456c >2014-01-30 04:50:07,474 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-47) [49bb0a07] After Installation host 10.70.37.158, VDS >2014-01-30 04:50:07,483 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-47) [49bb0a07] Correlation ID: 7ca40507, Job ID: 5fbbd295-17f0-499d-94fe-4ae237730af4, Call Stack: null, Custom Event ID: -1, Message: Host 10.70.37.158 installed >2014-01-30 04:50:07,489 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-47) [49bb0a07] Lock freed to object EngineLock [exclusiveLocks= key: 45e42dfd-602d-47ea-ad35-9ee3ce83655e value: VDS >, sharedLocks= ] >2014-01-30 04:50:07,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c5d1084 >2014-01-30 04:50:08,319 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-40) [1d283775] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:50:08,319 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-40) [1d283775] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:50:08,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3c5d1084 >2014-01-30 04:50:08,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64f637ab >2014-01-30 04:50:08,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b28c12de, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2938d57}, log id: 64f637ab >2014-01-30 04:50:08,769 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] START, GetHardwareInfoVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e, vds=Host[10.70.37.158]), log id: 30da7e8c >2014-01-30 04:50:08,833 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] FINISH, GetHardwareInfoVDSCommand, log id: 30da7e8c >2014-01-30 04:50:08,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6b64e86d >2014-01-30 04:50:09,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6b64e86d >2014-01-30 04:50:09,424 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] START, GetHardwareInfoVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e, vds=Host[10.70.37.158]), log id: 5d068b10 >2014-01-30 04:50:09,439 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] FINISH, GetHardwareInfoVDSCommand, log id: 5d068b10 >2014-01-30 04:50:09,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b9f7764 >2014-01-30 04:50:09,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [65dfb813] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2b9f7764 >2014-01-30 04:50:09,936 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-28) [65dfb813] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host 10.70.37.158. >2014-01-30 04:50:09,948 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-28) [5e84c02d] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 5849b030-626e-47cb-ad90-3ce782d831b3 Type: StoragePool >2014-01-30 04:50:09,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHostUUIDVDSCommand] (DefaultQuartzScheduler_Worker-28) [5e84c02d] START, GetGlusterHostUUIDVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77f47b29 >2014-01-30 04:50:10,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHostUUIDVDSCommand] (DefaultQuartzScheduler_Worker-28) [5e84c02d] FINISH, GetGlusterHostUUIDVDSCommand, return: 72110b4b-b4af-41f9-ba5f-69051d5279d9, log id: 77f47b29 >2014-01-30 04:50:10,200 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 45e42dfd-602d-47ea-ad35-9ee3ce83655e Type: VDS >2014-01-30 04:50:10,322 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-40) [1d283775] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:50:10,322 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (pool-5-thread-40) [1d283775] Command PollVDS execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException >2014-01-30 04:50:12,460 INFO [org.ovirt.engine.core.bll.network.host.CommitNetworkChangesCommand] (pool-5-thread-40) [4c872ad9] Running command: CommitNetworkChangesCommand internal: true. Entities affected : ID: 93ecedfe-3409-43cf-a0b2-b2247948eb75 Type: VDS >2014-01-30 04:50:12,463 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (pool-5-thread-40) [4c872ad9] START, SetSafeNetworkConfigVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 7c93696a >2014-01-30 04:50:12,500 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetSafeNetworkConfigVDSCommand] (pool-5-thread-40) [4c872ad9] FINISH, SetSafeNetworkConfigVDSCommand, log id: 7c93696a >2014-01-30 04:50:12,508 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-40) [4c872ad9] Correlation ID: 4c872ad9, Call Stack: null, Custom Event ID: -1, Message: Network changes were saved on host host1 >2014-01-30 04:50:12,510 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-40) [4c872ad9] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75, status=Initializing, nonOperationalReason=NONE), log id: 2266e577 >2014-01-30 04:50:12,514 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-40) [4c872ad9] FINISH, SetVdsStatusVDSCommand, log id: 2266e577 >2014-01-30 04:50:12,514 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-40) [4c872ad9] After Installation host host1, VDS >2014-01-30 04:50:12,525 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-40) [4c872ad9] Correlation ID: 524af277, Job ID: 21a00d5f-5ae1-43c7-accd-3186fafe6040, Call Stack: null, Custom Event ID: -1, Message: Host host1 installed >2014-01-30 04:50:12,532 INFO [org.ovirt.engine.core.bll.InstallVdsCommand] (pool-5-thread-40) [4c872ad9] Lock freed to object EngineLock [exclusiveLocks= key: 93ecedfe-3409-43cf-a0b2-b2247948eb75 value: VDS >, sharedLocks= ] >2014-01-30 04:50:13,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b51a310 >2014-01-30 04:50:14,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2b51a310 >2014-01-30 04:50:14,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ec1ba8b >2014-01-30 04:50:14,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa3d17c2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb8cdef0}, log id: 7ec1ba8b >2014-01-30 04:50:14,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3999782b >2014-01-30 04:50:14,840 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75, vds=Host[host1]), log id: 1dbf3300 >2014-01-30 04:50:14,900 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GetHardwareInfoVDSCommand, log id: 1dbf3300 >2014-01-30 04:50:14,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GlusterServersListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 609c533a >2014-01-30 04:50:15,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3999782b >2014-01-30 04:50:15,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3abdeac2 >2014-01-30 04:50:15,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3abdeac2 >2014-01-30 04:50:15,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GlusterServersListVDSCommand, return: [10.70.37.149:CONNECTED, 10.70.37.158:CONNECTED], log id: 609c533a >2014-01-30 04:50:15,441 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GetHardwareInfoVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75, vds=Host[host1]), log id: 3d3adad8 >2014-01-30 04:50:15,453 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.GetHardwareInfoVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GetHardwareInfoVDSCommand, log id: 3d3adad8 >2014-01-30 04:50:15,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] START, GlusterServersListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 4934cde8 >2014-01-30 04:50:15,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4accb6ba] FINISH, GlusterServersListVDSCommand, return: [10.70.37.149:CONNECTED, 10.70.37.158:CONNECTED], log id: 4934cde8 >2014-01-30 04:50:15,938 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-40) [4accb6ba] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: State was set to Up for host host1. >2014-01-30 04:50:15,949 INFO [org.ovirt.engine.core.bll.InitVdsOnUpCommand] (DefaultQuartzScheduler_Worker-40) [6770f54e] Running command: InitVdsOnUpCommand internal: true. Entities affected : ID: 5849b030-626e-47cb-ad90-3ce782d831b3 Type: StoragePool >2014-01-30 04:50:15,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHostUUIDVDSCommand] (DefaultQuartzScheduler_Worker-40) [6770f54e] START, GetGlusterHostUUIDVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: f9f6583 >2014-01-30 04:50:16,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHostUUIDVDSCommand] (DefaultQuartzScheduler_Worker-40) [6770f54e] FINISH, GetGlusterHostUUIDVDSCommand, return: d225e373-5036-4d81-b7b1-2019fec278f3, log id: f9f6583 >2014-01-30 04:50:16,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [6770f54e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2f31c77f >2014-01-30 04:50:16,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [6770f54e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2f31c77f >2014-01-30 04:50:16,710 INFO [org.ovirt.engine.core.bll.HandleVdsVersionCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] Running command: HandleVdsVersionCommand internal: true. Entities affected : ID: 93ecedfe-3409-43cf-a0b2-b2247948eb75 Type: VDS >2014-01-30 04:50:20,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b1207ab >2014-01-30 04:50:20,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4b1207ab >2014-01-30 04:50:20,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5aadc12a >2014-01-30 04:50:21,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9769637, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4b0bf98}, log id: 5aadc12a >2014-01-30 04:50:21,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3d9f701b >2014-01-30 04:50:21,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3d9f701b >2014-01-30 04:50:21,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 479d6c2f >2014-01-30 04:50:21,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 479d6c2f >2014-01-30 04:50:26,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ff5f772 >2014-01-30 04:50:27,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1ff5f772 >2014-01-30 04:50:27,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 755555eb >2014-01-30 04:50:27,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af78b001, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6144ec6}, log id: 755555eb >2014-01-30 04:50:27,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6853111d >2014-01-30 04:50:28,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6853111d >2014-01-30 04:50:28,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 578192 >2014-01-30 04:50:28,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 578192 >2014-01-30 04:50:33,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19f65f1d >2014-01-30 04:50:33,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 19f65f1d >2014-01-30 04:50:33,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 171f49ec >2014-01-30 04:50:34,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@730c4de9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69282f8}, log id: 171f49ec >2014-01-30 04:50:34,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1b6469a4 >2014-01-30 04:50:34,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1b6469a4 >2014-01-30 04:50:34,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 57cc721d >2014-01-30 04:50:34,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57cc721d >2014-01-30 04:50:40,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2aa24a48 >2014-01-30 04:50:40,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2aa24a48 >2014-01-30 04:50:40,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a9ac94b >2014-01-30 04:50:40,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45dbb8e2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8abd2df3}, log id: 5a9ac94b >2014-01-30 04:50:40,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 44768bb5 >2014-01-30 04:50:41,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 44768bb5 >2014-01-30 04:50:41,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77ad45e5 >2014-01-30 04:50:41,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77ad45e5 >2014-01-30 04:50:46,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ac1b9cd >2014-01-30 04:50:47,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7ac1b9cd >2014-01-30 04:50:47,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 224cb0bd >2014-01-30 04:50:47,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d27201a1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f799f1a7}, log id: 224cb0bd >2014-01-30 04:50:47,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 52be1b28 >2014-01-30 04:50:47,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 52be1b28 >2014-01-30 04:50:47,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 61d3a6a8 >2014-01-30 04:50:48,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61d3a6a8 >2014-01-30 04:50:53,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 34cd141f >2014-01-30 04:50:53,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 34cd141f >2014-01-30 04:50:53,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9fe3d61 >2014-01-30 04:50:53,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3aff193a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9d58676}, log id: 9fe3d61 >2014-01-30 04:50:53,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5bce94ae >2014-01-30 04:50:54,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5bce94ae >2014-01-30 04:50:54,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3cd8755b >2014-01-30 04:50:54,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cd8755b >2014-01-30 04:50:55,066 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-12) [690883a1] No up server in cluster >2014-01-30 04:50:55,067 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-12) [690883a1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:50:55,069 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-12) [690883a1] No up server in cluster >2014-01-30 04:50:55,069 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-12) [690883a1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:50:55,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b88d4e8 >2014-01-30 04:50:55,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 6b88d4e8 >2014-01-30 04:50:55,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5515b92f >2014-01-30 04:50:55,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterTasksListVDSCommand, return: [], log id: 5515b92f >2014-01-30 04:50:59,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 723f886c >2014-01-30 04:51:00,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 723f886c >2014-01-30 04:51:00,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 472cdbf1 >2014-01-30 04:51:00,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b79dcc77, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b1c0e85}, log id: 472cdbf1 >2014-01-30 04:51:00,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 8634e4c >2014-01-30 04:51:00,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 8634e4c >2014-01-30 04:51:00,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77a6012 >2014-01-30 04:51:01,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77a6012 >2014-01-30 04:51:06,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e8a7d2b >2014-01-30 04:51:06,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2e8a7d2b >2014-01-30 04:51:06,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12ca4118 >2014-01-30 04:51:07,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c34c0052, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40c8f950}, log id: 12ca4118 >2014-01-30 04:51:07,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 9a9021d >2014-01-30 04:51:07,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 9a9021d >2014-01-30 04:51:07,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6a79978d >2014-01-30 04:51:07,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a79978d >2014-01-30 04:51:12,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36e97e32 >2014-01-30 04:51:13,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 36e97e32 >2014-01-30 04:51:13,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25feff97 >2014-01-30 04:51:13,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d481a28, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3d810e2}, log id: 25feff97 >2014-01-30 04:51:13,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3782f67e >2014-01-30 04:51:14,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3782f67e >2014-01-30 04:51:14,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4eb98bd6 >2014-01-30 04:51:14,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4eb98bd6 >2014-01-30 04:51:19,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a2f1c25 >2014-01-30 04:51:19,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3a2f1c25 >2014-01-30 04:51:19,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 144e6ecd >2014-01-30 04:51:20,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bea22d2c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e77be93d}, log id: 144e6ecd >2014-01-30 04:51:20,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3b3371a >2014-01-30 04:51:20,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3b3371a >2014-01-30 04:51:20,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5d72dba2 >2014-01-30 04:51:20,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d72dba2 >2014-01-30 04:51:25,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 34fc4d59 >2014-01-30 04:51:26,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 34fc4d59 >2014-01-30 04:51:26,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76f71e2e >2014-01-30 04:51:26,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@162551ce, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28428e4a}, log id: 76f71e2e >2014-01-30 04:51:26,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4c692ff5 >2014-01-30 04:51:27,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4c692ff5 >2014-01-30 04:51:27,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3dc60d49 >2014-01-30 04:51:27,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3dc60d49 >2014-01-30 04:51:32,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26b43b19 >2014-01-30 04:51:32,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 26b43b19 >2014-01-30 04:51:32,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6734273b >2014-01-30 04:51:33,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f69ac6c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4647d84}, log id: 6734273b >2014-01-30 04:51:33,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 572aa4f3 >2014-01-30 04:51:33,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 572aa4f3 >2014-01-30 04:51:33,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 548cc002 >2014-01-30 04:51:34,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 548cc002 >2014-01-30 04:51:39,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b30c2a6 >2014-01-30 04:51:39,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b30c2a6 >2014-01-30 04:51:39,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7432e468 >2014-01-30 04:51:39,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bd90b37, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64c9da39}, log id: 7432e468 >2014-01-30 04:51:39,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 67ead8a9 >2014-01-30 04:51:40,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 67ead8a9 >2014-01-30 04:51:40,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 87be833 >2014-01-30 04:51:40,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 87be833 >2014-01-30 04:51:45,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4bc033ff >2014-01-30 04:51:46,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4bc033ff >2014-01-30 04:51:46,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5cc29b6b >2014-01-30 04:51:46,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e4ea30f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e314c94}, log id: 5cc29b6b >2014-01-30 04:51:46,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2cad0c6e >2014-01-30 04:51:46,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2cad0c6e >2014-01-30 04:51:46,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 667895dc >2014-01-30 04:51:47,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 667895dc >2014-01-30 04:51:52,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 229ae055 >2014-01-30 04:51:52,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 229ae055 >2014-01-30 04:51:52,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 548c06fc >2014-01-30 04:51:52,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37bc7d17, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41eb87c3}, log id: 548c06fc >2014-01-30 04:51:52,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c254bca >2014-01-30 04:51:53,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5c254bca >2014-01-30 04:51:53,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 369c8c35 >2014-01-30 04:51:53,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 369c8c35 >2014-01-30 04:51:55,886 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] No up server in cluster >2014-01-30 04:51:55,887 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:51:55,890 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] No up server in cluster >2014-01-30 04:51:55,890 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:51:55,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 281dcdad >2014-01-30 04:51:56,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 281dcdad >2014-01-30 04:51:56,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 18f53c85 >2014-01-30 04:51:56,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterTasksListVDSCommand, return: [], log id: 18f53c85 >2014-01-30 04:51:58,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2fbd3b13 >2014-01-30 04:51:59,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2fbd3b13 >2014-01-30 04:51:59,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76ea2d4e >2014-01-30 04:51:59,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dbdfbae4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a91fb5e8}, log id: 76ea2d4e >2014-01-30 04:51:59,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 53106cf2 >2014-01-30 04:51:59,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 53106cf2 >2014-01-30 04:51:59,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 400106e2 >2014-01-30 04:52:00,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 400106e2 >2014-01-30 04:52:05,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: cb11e7f >2014-01-30 04:52:05,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: cb11e7f >2014-01-30 04:52:05,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b71c85e >2014-01-30 04:52:06,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa1cc2a8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41fced2f}, log id: 3b71c85e >2014-01-30 04:52:06,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 67fe816d >2014-01-30 04:52:06,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 67fe816d >2014-01-30 04:52:06,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 62b1b9c >2014-01-30 04:52:06,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62b1b9c >2014-01-30 04:52:11,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 451f49c0 >2014-01-30 04:52:12,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 451f49c0 >2014-01-30 04:52:12,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 57e2e6d0 >2014-01-30 04:52:12,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@959d7654, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d12ba342}, log id: 57e2e6d0 >2014-01-30 04:52:12,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 29cde2aa >2014-01-30 04:52:13,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 29cde2aa >2014-01-30 04:52:13,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2c72cf0e >2014-01-30 04:52:13,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c72cf0e >2014-01-30 04:52:18,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65287984 >2014-01-30 04:52:18,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 65287984 >2014-01-30 04:52:18,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f0b6286 >2014-01-30 04:52:19,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94eb0d82, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@297f6569}, log id: 6f0b6286 >2014-01-30 04:52:19,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 15f13fe3 >2014-01-30 04:52:19,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 15f13fe3 >2014-01-30 04:52:19,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 798caaab >2014-01-30 04:52:19,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 798caaab >2014-01-30 04:52:24,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 192da3fc >2014-01-30 04:52:25,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 192da3fc >2014-01-30 04:52:25,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42352ed6 >2014-01-30 04:52:25,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18a92baa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19765530}, log id: 42352ed6 >2014-01-30 04:52:25,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3f73b5cf >2014-01-30 04:52:26,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3f73b5cf >2014-01-30 04:52:26,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 518fccac >2014-01-30 04:52:26,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 518fccac >2014-01-30 04:52:31,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19121d8c >2014-01-30 04:52:32,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 19121d8c >2014-01-30 04:52:32,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32c2f322 >2014-01-30 04:52:32,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4aaa360, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a581ff08}, log id: 32c2f322 >2014-01-30 04:52:32,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5f335b54 >2014-01-30 04:52:32,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5f335b54 >2014-01-30 04:52:32,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: f2afaa0 >2014-01-30 04:52:33,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f2afaa0 >2014-01-30 04:52:38,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8c4210a >2014-01-30 04:52:38,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 8c4210a >2014-01-30 04:52:38,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26e4c521 >2014-01-30 04:52:38,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3501bf9d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c916c580}, log id: 26e4c521 >2014-01-30 04:52:38,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3bdab868 >2014-01-30 04:52:39,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3bdab868 >2014-01-30 04:52:39,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 660af892 >2014-01-30 04:52:39,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 660af892 >2014-01-30 04:52:44,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4382197 >2014-01-30 04:52:45,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4382197 >2014-01-30 04:52:45,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c1f4049 >2014-01-30 04:52:45,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c0d1109, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@afae73}, log id: 7c1f4049 >2014-01-30 04:52:45,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 60d5c92 >2014-01-30 04:52:46,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 60d5c92 >2014-01-30 04:52:46,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 45d3d38e >2014-01-30 04:52:46,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45d3d38e >2014-01-30 04:52:51,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: df32589 >2014-01-30 04:52:51,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: df32589 >2014-01-30 04:52:51,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 266fc1ce >2014-01-30 04:52:52,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb87b877, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a36ffd48}, log id: 266fc1ce >2014-01-30 04:52:52,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 78491138 >2014-01-30 04:52:52,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 78491138 >2014-01-30 04:52:52,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4fe69fab >2014-01-30 04:52:52,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fe69fab >2014-01-30 04:52:56,761 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-38) [478fa91d] No up server in cluster >2014-01-30 04:52:56,761 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-38) [478fa91d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:52:56,764 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-38) [478fa91d] No up server in cluster >2014-01-30 04:52:56,764 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-38) [478fa91d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:52:56,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 7b61f45 >2014-01-30 04:52:57,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 7b61f45 >2014-01-30 04:52:57,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b7a25b6 >2014-01-30 04:52:57,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterTasksListVDSCommand, return: [], log id: 2b7a25b6 >2014-01-30 04:52:57,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 362f859f >2014-01-30 04:52:58,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 362f859f >2014-01-30 04:52:58,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76e9f78c >2014-01-30 04:52:58,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ae6d728, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdee916d}, log id: 76e9f78c >2014-01-30 04:52:58,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 179c1776 >2014-01-30 04:52:59,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 179c1776 >2014-01-30 04:52:59,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1fa4517 >2014-01-30 04:52:59,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fa4517 >2014-01-30 04:53:04,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 503e919f >2014-01-30 04:53:04,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 503e919f >2014-01-30 04:53:04,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d8e736a >2014-01-30 04:53:05,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@861b268f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62259e5c}, log id: d8e736a >2014-01-30 04:53:05,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77bf3366 >2014-01-30 04:53:05,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 77bf3366 >2014-01-30 04:53:05,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3b85c23c >2014-01-30 04:53:05,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b85c23c >2014-01-30 04:53:10,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c58a824 >2014-01-30 04:53:11,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5c58a824 >2014-01-30 04:53:11,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ecb7403 >2014-01-30 04:53:11,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cc5961a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9675b16}, log id: 5ecb7403 >2014-01-30 04:53:11,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 127d6e33 >2014-01-30 04:53:12,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 127d6e33 >2014-01-30 04:53:12,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c3a53d8 >2014-01-30 04:53:12,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c3a53d8 >2014-01-30 04:53:17,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e51dd7e >2014-01-30 04:53:18,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3e51dd7e >2014-01-30 04:53:18,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7fc4afc4 >2014-01-30 04:53:18,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d700d1f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dae8a363}, log id: 7fc4afc4 >2014-01-30 04:53:18,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 374438eb >2014-01-30 04:53:18,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 374438eb >2014-01-30 04:53:18,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 179d08de >2014-01-30 04:53:19,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 179d08de >2014-01-30 04:53:24,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3cca9497 >2014-01-30 04:53:24,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3cca9497 >2014-01-30 04:53:24,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25103241 >2014-01-30 04:53:24,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97835bc0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f32d6f5}, log id: 25103241 >2014-01-30 04:53:24,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7e456c12 >2014-01-30 04:53:25,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7e456c12 >2014-01-30 04:53:25,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 76bc651e >2014-01-30 04:53:25,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76bc651e >2014-01-30 04:53:30,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ab1c6bc >2014-01-30 04:53:31,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5ab1c6bc >2014-01-30 04:53:31,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a4f8443 >2014-01-30 04:53:31,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85128465, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9ad7cfc}, log id: 3a4f8443 >2014-01-30 04:53:31,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 669b9c9 >2014-01-30 04:53:31,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 669b9c9 >2014-01-30 04:53:31,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: e7687db >2014-01-30 04:53:32,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e7687db >2014-01-30 04:53:37,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52c85753 >2014-01-30 04:53:37,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 52c85753 >2014-01-30 04:53:37,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b58567b >2014-01-30 04:53:38,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29078dc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3f2d564}, log id: 7b58567b >2014-01-30 04:53:38,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 39a42f3c >2014-01-30 04:53:38,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 39a42f3c >2014-01-30 04:53:38,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 35dffc79 >2014-01-30 04:53:38,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35dffc79 >2014-01-30 04:53:43,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c3f89e1 >2014-01-30 04:53:44,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4c3f89e1 >2014-01-30 04:53:44,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40cf1543 >2014-01-30 04:53:44,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e6546cb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89e3f5b3}, log id: 40cf1543 >2014-01-30 04:53:44,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1a9fdaf8 >2014-01-30 04:53:45,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1a9fdaf8 >2014-01-30 04:53:45,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 28ffcbfe >2014-01-30 04:53:45,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28ffcbfe >2014-01-30 04:53:50,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 794333fe >2014-01-30 04:53:50,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 794333fe >2014-01-30 04:53:50,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13e67c94 >2014-01-30 04:53:51,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f863c98f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83067947}, log id: 13e67c94 >2014-01-30 04:53:51,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 183b26 >2014-01-30 04:53:51,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 183b26 >2014-01-30 04:53:51,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 75d8274f >2014-01-30 04:53:51,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75d8274f >2014-01-30 04:53:56,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 524d7e00 >2014-01-30 04:53:57,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 524d7e00 >2014-01-30 04:53:57,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4788b87c >2014-01-30 04:53:57,569 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] No up server in cluster >2014-01-30 04:53:57,569 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:53:57,571 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] No up server in cluster >2014-01-30 04:53:57,571 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:53:57,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: bbe0ed1 >2014-01-30 04:53:57,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ddfc3b4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b26ff11}, log id: 4788b87c >2014-01-30 04:53:57,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 741545ba >2014-01-30 04:53:58,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: bbe0ed1 >2014-01-30 04:53:58,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 23277af0 >2014-01-30 04:53:58,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 741545ba >2014-01-30 04:53:58,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 23677a3f >2014-01-30 04:53:58,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterTasksListVDSCommand, return: [], log id: 23277af0 >2014-01-30 04:53:58,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23677a3f >2014-01-30 04:54:03,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54077b1d >2014-01-30 04:54:03,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 54077b1d >2014-01-30 04:54:03,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77fed442 >2014-01-30 04:54:04,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99e0fcdd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1a0ccce}, log id: 77fed442 >2014-01-30 04:54:04,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5a4acb2e >2014-01-30 04:54:04,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5a4acb2e >2014-01-30 04:54:04,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c54a402 >2014-01-30 04:54:04,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c54a402 >2014-01-30 04:54:09,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5953eac2 >2014-01-30 04:54:10,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5953eac2 >2014-01-30 04:54:10,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69308c2 >2014-01-30 04:54:10,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0daf568, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d592c87}, log id: 69308c2 >2014-01-30 04:54:10,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4f6d3dff >2014-01-30 04:54:11,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4f6d3dff >2014-01-30 04:54:11,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 41eb0bbb >2014-01-30 04:54:11,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41eb0bbb >2014-01-30 04:54:16,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 131d0d0e >2014-01-30 04:54:16,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 131d0d0e >2014-01-30 04:54:16,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8fa6822 >2014-01-30 04:54:17,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73c76864, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b04617ac}, log id: 8fa6822 >2014-01-30 04:54:17,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3861f616 >2014-01-30 04:54:17,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3861f616 >2014-01-30 04:54:17,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 121aaecf >2014-01-30 04:54:18,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 121aaecf >2014-01-30 04:54:23,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41f9c02d >2014-01-30 04:54:23,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 41f9c02d >2014-01-30 04:54:23,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4289788e >2014-01-30 04:54:23,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28180610, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5915e298}, log id: 4289788e >2014-01-30 04:54:23,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 516f84f6 >2014-01-30 04:54:24,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 516f84f6 >2014-01-30 04:54:24,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1631965c >2014-01-30 04:54:24,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1631965c >2014-01-30 04:54:29,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e051d >2014-01-30 04:54:30,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: e051d >2014-01-30 04:54:30,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41a2511a >2014-01-30 04:54:30,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@831a94dd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58503515}, log id: 41a2511a >2014-01-30 04:54:30,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2f248707 >2014-01-30 04:54:30,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2f248707 >2014-01-30 04:54:30,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6f20aa8e >2014-01-30 04:54:31,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f20aa8e >2014-01-30 04:54:36,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e4d4e3e >2014-01-30 04:54:36,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e4d4e3e >2014-01-30 04:54:36,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d3fc0be >2014-01-30 04:54:36,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6563791a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@678cbad0}, log id: 6d3fc0be >2014-01-30 04:54:36,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 62e2e70 >2014-01-30 04:54:37,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 62e2e70 >2014-01-30 04:54:37,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 68fbc6e4 >2014-01-30 04:54:37,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68fbc6e4 >2014-01-30 04:54:42,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2cc605cb >2014-01-30 04:54:43,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2cc605cb >2014-01-30 04:54:43,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 47b40ef1 >2014-01-30 04:54:43,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8beb7aee, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5603d412}, log id: 47b40ef1 >2014-01-30 04:54:43,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1a189833 >2014-01-30 04:54:43,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1a189833 >2014-01-30 04:54:43,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 20fe29f2 >2014-01-30 04:54:44,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20fe29f2 >2014-01-30 04:54:49,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10529453 >2014-01-30 04:54:49,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 10529453 >2014-01-30 04:54:49,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4508aa65 >2014-01-30 04:54:50,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7b94092, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@134a29b2}, log id: 4508aa65 >2014-01-30 04:54:50,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2ccb1eba >2014-01-30 04:54:50,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2ccb1eba >2014-01-30 04:54:50,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 695f40cb >2014-01-30 04:54:50,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ed37033 >2014-01-30 04:54:50,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 695f40cb >2014-01-30 04:54:51,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@589299fe, log id: 5ed37033 >2014-01-30 04:54:51,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: bc2020 >2014-01-30 04:54:51,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4f257dbe, log id: bc2020 >2014-01-30 04:54:55,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19abaa96 >2014-01-30 04:54:56,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 19abaa96 >2014-01-30 04:54:56,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e76901e >2014-01-30 04:54:56,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2bef697, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ea8c14a}, log id: e76901e >2014-01-30 04:54:56,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6581e6a6 >2014-01-30 04:54:57,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6581e6a6 >2014-01-30 04:54:57,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5ae5ce35 >2014-01-30 04:54:57,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ae5ce35 >2014-01-30 04:54:58,340 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) [1f17c565] No up server in cluster >2014-01-30 04:54:58,341 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) [1f17c565] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:54:58,344 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) [1f17c565] No up server in cluster >2014-01-30 04:54:58,344 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) [1f17c565] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:54:58,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 3503b541 >2014-01-30 04:54:58,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 3503b541 >2014-01-30 04:54:58,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 55332184 >2014-01-30 04:54:59,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterTasksListVDSCommand, return: [], log id: 55332184 >2014-01-30 04:55:02,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79bb87f1 >2014-01-30 04:55:02,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 79bb87f1 >2014-01-30 04:55:02,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f35a392 >2014-01-30 04:55:03,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88ae583f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6152fd19}, log id: 3f35a392 >2014-01-30 04:55:03,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 715e6cca >2014-01-30 04:55:03,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 715e6cca >2014-01-30 04:55:03,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: c23e7f1 >2014-01-30 04:55:03,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c23e7f1 >2014-01-30 04:55:08,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1437bd4 >2014-01-30 04:55:09,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1437bd4 >2014-01-30 04:55:09,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 119f2e81 >2014-01-30 04:55:09,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a02e74d5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@216a0433}, log id: 119f2e81 >2014-01-30 04:55:09,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 37c98db5 >2014-01-30 04:55:10,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 37c98db5 >2014-01-30 04:55:10,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: c3af01c >2014-01-30 04:55:10,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c3af01c >2014-01-30 04:55:15,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 255792a4 >2014-01-30 04:55:15,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 255792a4 >2014-01-30 04:55:15,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4830d30f >2014-01-30 04:55:16,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccbd5618, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ec8e912}, log id: 4830d30f >2014-01-30 04:55:16,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 15b04719 >2014-01-30 04:55:16,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 15b04719 >2014-01-30 04:55:16,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6347ac47 >2014-01-30 04:55:17,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6347ac47 >2014-01-30 04:55:22,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7cff9e76 >2014-01-30 04:55:22,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7cff9e76 >2014-01-30 04:55:22,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48d46e3 >2014-01-30 04:55:22,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d543cf2c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35592a82}, log id: 48d46e3 >2014-01-30 04:55:22,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4dd41d34 >2014-01-30 04:55:23,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4dd41d34 >2014-01-30 04:55:23,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 44af77d2 >2014-01-30 04:55:23,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44af77d2 >2014-01-30 04:55:28,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b0c0211 >2014-01-30 04:55:29,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2b0c0211 >2014-01-30 04:55:29,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ef3f8b0 >2014-01-30 04:55:29,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5daaee, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79811252}, log id: 2ef3f8b0 >2014-01-30 04:55:29,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 691bd7d9 >2014-01-30 04:55:29,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 691bd7d9 >2014-01-30 04:55:29,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 76c56743 >2014-01-30 04:55:30,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76c56743 >2014-01-30 04:55:35,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40bc56ae >2014-01-30 04:55:35,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 40bc56ae >2014-01-30 04:55:35,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f694edc >2014-01-30 04:55:35,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16fb3929, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fc18a91}, log id: 7f694edc >2014-01-30 04:55:35,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 47960a20 >2014-01-30 04:55:36,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 47960a20 >2014-01-30 04:55:36,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7fb2c3ae >2014-01-30 04:55:36,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fb2c3ae >2014-01-30 04:55:41,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49065a66 >2014-01-30 04:55:42,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 49065a66 >2014-01-30 04:55:42,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a8b6351 >2014-01-30 04:55:42,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6128115, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c88a1c05}, log id: 5a8b6351 >2014-01-30 04:55:42,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1d072140 >2014-01-30 04:55:43,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1d072140 >2014-01-30 04:55:43,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ef0cc2c >2014-01-30 04:55:43,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ef0cc2c >2014-01-30 04:55:48,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4522d4bf >2014-01-30 04:55:48,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4522d4bf >2014-01-30 04:55:48,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c828be2 >2014-01-30 04:55:49,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47113999, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@893e704f}, log id: 3c828be2 >2014-01-30 04:55:49,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 79f7fb91 >2014-01-30 04:55:49,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 79f7fb91 >2014-01-30 04:55:49,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1169c452 >2014-01-30 04:55:49,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1169c452 >2014-01-30 04:55:54,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5653877e >2014-01-30 04:55:55,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5653877e >2014-01-30 04:55:55,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 240fa9c >2014-01-30 04:55:55,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f52486a5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78714d76}, log id: 240fa9c >2014-01-30 04:55:55,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 24f85a1d >2014-01-30 04:55:56,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 24f85a1d >2014-01-30 04:55:56,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 16ba9055 >2014-01-30 04:55:56,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16ba9055 >2014-01-30 04:55:59,186 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] No up server in cluster >2014-01-30 04:55:59,186 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:55:59,189 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] No up server in cluster >2014-01-30 04:55:59,190 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:55:59,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 7067f67b >2014-01-30 04:55:59,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 7067f67b >2014-01-30 04:55:59,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3013e122 >2014-01-30 04:56:00,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterTasksListVDSCommand, return: [], log id: 3013e122 >2014-01-30 04:56:01,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72d92bd6 >2014-01-30 04:56:01,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 72d92bd6 >2014-01-30 04:56:01,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b71872f >2014-01-30 04:56:02,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@119439e0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bd9c2dd}, log id: 2b71872f >2014-01-30 04:56:02,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7061b9ca >2014-01-30 04:56:02,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7061b9ca >2014-01-30 04:56:02,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2fe5132e >2014-01-30 04:56:02,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2fe5132e >2014-01-30 04:56:07,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7dd7d316 >2014-01-30 04:56:08,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7dd7d316 >2014-01-30 04:56:08,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7865a6a9 >2014-01-30 04:56:08,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60e55a20, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3da81cc0}, log id: 7865a6a9 >2014-01-30 04:56:08,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 457278b7 >2014-01-30 04:56:09,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 457278b7 >2014-01-30 04:56:09,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 54769445 >2014-01-30 04:56:09,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54769445 >2014-01-30 04:56:14,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 39ce4c0d >2014-01-30 04:56:15,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 39ce4c0d >2014-01-30 04:56:15,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68cac9c7 >2014-01-30 04:56:15,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4925a5f6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@517e1eef}, log id: 68cac9c7 >2014-01-30 04:56:15,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3910347 >2014-01-30 04:56:15,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3910347 >2014-01-30 04:56:15,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 747c7b51 >2014-01-30 04:56:16,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 747c7b51 >2014-01-30 04:56:21,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5df62c2e >2014-01-30 04:56:21,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5df62c2e >2014-01-30 04:56:21,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7420459 >2014-01-30 04:56:21,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea0a60a0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa4afdea}, log id: 7420459 >2014-01-30 04:56:21,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 323a6eee >2014-01-30 04:56:22,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 323a6eee >2014-01-30 04:56:22,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 495934e8 >2014-01-30 04:56:22,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 495934e8 >2014-01-30 04:56:27,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58ff5fa2 >2014-01-30 04:56:28,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 58ff5fa2 >2014-01-30 04:56:28,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c3d3894 >2014-01-30 04:56:28,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20d9383b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51dad61e}, log id: c3d3894 >2014-01-30 04:56:28,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5bf25feb >2014-01-30 04:56:28,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5bf25feb >2014-01-30 04:56:28,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: c2ca17b >2014-01-30 04:56:29,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c2ca17b >2014-01-30 04:56:34,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 236ac549 >2014-01-30 04:56:34,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 236ac549 >2014-01-30 04:56:34,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: da551cb >2014-01-30 04:56:34,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d53affd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e56c0d}, log id: da551cb >2014-01-30 04:56:34,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 552f0e6e >2014-01-30 04:56:35,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 552f0e6e >2014-01-30 04:56:35,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6d267162 >2014-01-30 04:56:35,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d267162 >2014-01-30 04:56:40,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 55f814e5 >2014-01-30 04:56:41,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 55f814e5 >2014-01-30 04:56:41,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2cf88063 >2014-01-30 04:56:41,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b187ab4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7abf43f4}, log id: 2cf88063 >2014-01-30 04:56:41,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4852e503 >2014-01-30 04:56:42,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4852e503 >2014-01-30 04:56:42,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 340d9c7c >2014-01-30 04:56:42,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 340d9c7c >2014-01-30 04:56:47,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a29e253 >2014-01-30 04:56:47,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3a29e253 >2014-01-30 04:56:47,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 538ad1af >2014-01-30 04:56:48,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8070e545, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a72028b5}, log id: 538ad1af >2014-01-30 04:56:48,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2bea8bee >2014-01-30 04:56:48,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2bea8bee >2014-01-30 04:56:48,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4f4022aa >2014-01-30 04:56:48,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f4022aa >2014-01-30 04:56:53,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 745b2623 >2014-01-30 04:56:54,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 745b2623 >2014-01-30 04:56:54,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c03997e >2014-01-30 04:56:54,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14732c04, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32d8d804}, log id: 1c03997e >2014-01-30 04:56:54,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2e5b53e >2014-01-30 04:56:55,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2e5b53e >2014-01-30 04:56:55,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5948ce0 >2014-01-30 04:56:55,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5948ce0 >2014-01-30 04:57:00,020 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-10) [641a6d1] No up server in cluster >2014-01-30 04:57:00,020 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-10) [641a6d1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:57:00,023 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-10) [641a6d1] No up server in cluster >2014-01-30 04:57:00,023 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-10) [641a6d1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:57:00,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 7d93b4cf >2014-01-30 04:57:00,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b137aab >2014-01-30 04:57:00,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 7d93b4cf >2014-01-30 04:57:00,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5d6df508 >2014-01-30 04:57:00,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterTasksListVDSCommand, return: [], log id: 5d6df508 >2014-01-30 04:57:00,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2b137aab >2014-01-30 04:57:00,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 165919a4 >2014-01-30 04:57:01,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5abd54c1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@191f0470}, log id: 165919a4 >2014-01-30 04:57:01,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 32a57fb0 >2014-01-30 04:57:01,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 32a57fb0 >2014-01-30 04:57:01,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7ed20efe >2014-01-30 04:57:01,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ed20efe >2014-01-30 04:57:06,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b3fdf8b >2014-01-30 04:57:07,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: b3fdf8b >2014-01-30 04:57:07,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38c6642b >2014-01-30 04:57:07,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d585cb8c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cef34217}, log id: 38c6642b >2014-01-30 04:57:07,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 20c415f1 >2014-01-30 04:57:08,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 20c415f1 >2014-01-30 04:57:08,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1663489d >2014-01-30 04:57:08,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1663489d >2014-01-30 04:57:13,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b0c80e1 >2014-01-30 04:57:13,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b0c80e1 >2014-01-30 04:57:13,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6334732a >2014-01-30 04:57:14,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f18a0f2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba34cbf5}, log id: 6334732a >2014-01-30 04:57:14,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1c2856fb >2014-01-30 04:57:14,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1c2856fb >2014-01-30 04:57:14,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1570bb65 >2014-01-30 04:57:14,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1570bb65 >2014-01-30 04:57:19,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7da13764 >2014-01-30 04:57:20,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7da13764 >2014-01-30 04:57:20,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6565f5bb >2014-01-30 04:57:20,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abe665d5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@519d8062}, log id: 6565f5bb >2014-01-30 04:57:20,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e234bc0 >2014-01-30 04:57:21,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4e234bc0 >2014-01-30 04:57:21,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: f35f1b9 >2014-01-30 04:57:21,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f35f1b9 >2014-01-30 04:57:26,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52c89e29 >2014-01-30 04:57:27,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 52c89e29 >2014-01-30 04:57:27,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31cf1ccd >2014-01-30 04:57:27,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@499f70d7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a514fb}, log id: 31cf1ccd >2014-01-30 04:57:27,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6274a48e >2014-01-30 04:57:27,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6274a48e >2014-01-30 04:57:27,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 353b01cc >2014-01-30 04:57:28,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 353b01cc >2014-01-30 04:57:33,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44df5102 >2014-01-30 04:57:33,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 44df5102 >2014-01-30 04:57:33,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: fff8c7f >2014-01-30 04:57:33,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46959f0d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22d9ac15}, log id: fff8c7f >2014-01-30 04:57:33,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 474b7ffb >2014-01-30 04:57:34,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 474b7ffb >2014-01-30 04:57:34,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: c24f69c >2014-01-30 04:57:34,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c24f69c >2014-01-30 04:57:39,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e2234e3 >2014-01-30 04:57:40,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3e2234e3 >2014-01-30 04:57:40,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 695c038f >2014-01-30 04:57:40,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8faca20, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3911e5c5}, log id: 695c038f >2014-01-30 04:57:40,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7ea287d2 >2014-01-30 04:57:40,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7ea287d2 >2014-01-30 04:57:40,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c091254 >2014-01-30 04:57:41,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c091254 >2014-01-30 04:57:46,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52a8d55e >2014-01-30 04:57:46,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 52a8d55e >2014-01-30 04:57:46,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 454edc4a >2014-01-30 04:57:46,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee666fce, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6aef5f2}, log id: 454edc4a >2014-01-30 04:57:47,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 471f1939 >2014-01-30 04:57:47,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 471f1939 >2014-01-30 04:57:47,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 71f04afe >2014-01-30 04:57:47,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71f04afe >2014-01-30 04:57:52,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 47b7a295 >2014-01-30 04:57:53,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 47b7a295 >2014-01-30 04:57:53,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 62ed75f6 >2014-01-30 04:57:53,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cacd8050, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b3a4e19}, log id: 62ed75f6 >2014-01-30 04:57:53,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: c90248e >2014-01-30 04:57:54,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: c90248e >2014-01-30 04:57:54,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2f181a1a >2014-01-30 04:57:54,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f181a1a >2014-01-30 04:57:59,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 558d7224 >2014-01-30 04:57:59,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 558d7224 >2014-01-30 04:57:59,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2717d2f5 >2014-01-30 04:58:00,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f702fe12, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1e2bf2d}, log id: 2717d2f5 >2014-01-30 04:58:00,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 24e81995 >2014-01-30 04:58:00,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 24e81995 >2014-01-30 04:58:00,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7e48322d >2014-01-30 04:58:00,835 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-37) [2a3b7700] No up server in cluster >2014-01-30 04:58:00,835 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:58:00,838 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-37) [2a3b7700] No up server in cluster >2014-01-30 04:58:00,838 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:58:00,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 40bad5e8 >2014-01-30 04:58:00,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e48322d >2014-01-30 04:58:01,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 40bad5e8 >2014-01-30 04:58:01,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 765d44bc >2014-01-30 04:58:01,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterTasksListVDSCommand, return: [], log id: 765d44bc >2014-01-30 04:58:06,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ef026db >2014-01-30 04:58:06,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4ef026db >2014-01-30 04:58:06,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5dea7b69 >2014-01-30 04:58:06,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b94f52d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97d59994}, log id: 5dea7b69 >2014-01-30 04:58:06,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b177885 >2014-01-30 04:58:07,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2b177885 >2014-01-30 04:58:07,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 46c5d92 >2014-01-30 04:58:07,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46c5d92 >2014-01-30 04:58:12,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48b6e50b >2014-01-30 04:58:13,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 48b6e50b >2014-01-30 04:58:13,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 578f9196 >2014-01-30 04:58:13,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ec42732, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@855eba3a}, log id: 578f9196 >2014-01-30 04:58:13,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4bd271e >2014-01-30 04:58:13,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4bd271e >2014-01-30 04:58:13,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 672728e6 >2014-01-30 04:58:14,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 672728e6 >2014-01-30 04:58:19,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21f18f54 >2014-01-30 04:58:19,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 21f18f54 >2014-01-30 04:58:19,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2408a8da >2014-01-30 04:58:19,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47a2ce83, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f50ba3aa}, log id: 2408a8da >2014-01-30 04:58:19,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 79cd1f65 >2014-01-30 04:58:20,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 79cd1f65 >2014-01-30 04:58:20,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 419b6667 >2014-01-30 04:58:20,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 419b6667 >2014-01-30 04:58:25,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37fb3ece >2014-01-30 04:58:26,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 37fb3ece >2014-01-30 04:58:26,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11e40ba4 >2014-01-30 04:58:26,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b6e83bf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b11d7eb}, log id: 11e40ba4 >2014-01-30 04:58:26,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d25575f >2014-01-30 04:58:27,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: d25575f >2014-01-30 04:58:27,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6efff157 >2014-01-30 04:58:27,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6efff157 >2014-01-30 04:58:32,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44d55b96 >2014-01-30 04:58:32,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 44d55b96 >2014-01-30 04:58:32,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1878e7dd >2014-01-30 04:58:33,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39a0ee3b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b4bde09}, log id: 1878e7dd >2014-01-30 04:58:33,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4b3afa64 >2014-01-30 04:58:33,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4b3afa64 >2014-01-30 04:58:33,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 37081af5 >2014-01-30 04:58:33,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37081af5 >2014-01-30 04:58:38,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23064163 >2014-01-30 04:58:39,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 23064163 >2014-01-30 04:58:39,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5526db2 >2014-01-30 04:58:39,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3dff2292, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5cda7775}, log id: 5526db2 >2014-01-30 04:58:39,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b4c89be >2014-01-30 04:58:40,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2b4c89be >2014-01-30 04:58:40,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 247e366e >2014-01-30 04:58:40,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 247e366e >2014-01-30 04:58:45,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31a0bd8c >2014-01-30 04:58:46,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 31a0bd8c >2014-01-30 04:58:46,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: efb6939 >2014-01-30 04:58:46,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebb22325, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b6d20f}, log id: efb6939 >2014-01-30 04:58:46,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2c1c9830 >2014-01-30 04:58:46,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2c1c9830 >2014-01-30 04:58:46,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 706e5b72 >2014-01-30 04:58:47,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 706e5b72 >2014-01-30 04:58:52,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 128bcb25 >2014-01-30 04:58:52,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 128bcb25 >2014-01-30 04:58:52,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f765b62 >2014-01-30 04:58:52,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b450d27f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9cb5595}, log id: 7f765b62 >2014-01-30 04:58:52,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 78e13467 >2014-01-30 04:58:53,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 78e13467 >2014-01-30 04:58:53,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c4e165a >2014-01-30 04:58:53,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c4e165a >2014-01-30 04:58:58,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ce962d5 >2014-01-30 04:58:59,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3ce962d5 >2014-01-30 04:58:59,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ccafde5 >2014-01-30 04:58:59,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba52379d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9fb0288}, log id: ccafde5 >2014-01-30 04:58:59,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6a8a76bd >2014-01-30 04:58:59,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6a8a76bd >2014-01-30 04:58:59,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 146bc0d9 >2014-01-30 04:59:00,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 146bc0d9 >2014-01-30 04:59:01,646 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) [78fb20d6] No up server in cluster >2014-01-30 04:59:01,646 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) [78fb20d6] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:59:01,650 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) [78fb20d6] No up server in cluster >2014-01-30 04:59:01,650 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) [78fb20d6] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 04:59:01,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 5809392d >2014-01-30 04:59:02,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 5809392d >2014-01-30 04:59:02,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 6b5e8c63 >2014-01-30 04:59:02,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterTasksListVDSCommand, return: [], log id: 6b5e8c63 >2014-01-30 04:59:05,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 345f881 >2014-01-30 04:59:05,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 345f881 >2014-01-30 04:59:05,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 57814f9e >2014-01-30 04:59:05,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d1139d2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5373c17}, log id: 57814f9e >2014-01-30 04:59:06,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7fe9b8f4 >2014-01-30 04:59:06,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7fe9b8f4 >2014-01-30 04:59:06,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3a82b0c7 >2014-01-30 04:59:06,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a82b0c7 >2014-01-30 04:59:11,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77334240 >2014-01-30 04:59:12,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 77334240 >2014-01-30 04:59:12,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5430f940 >2014-01-30 04:59:12,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd09e6a4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e4c530f}, log id: 5430f940 >2014-01-30 04:59:12,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 40a4f946 >2014-01-30 04:59:13,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 40a4f946 >2014-01-30 04:59:13,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6936bb00 >2014-01-30 04:59:13,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6936bb00 >2014-01-30 04:59:18,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6fd53a36 >2014-01-30 04:59:18,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6fd53a36 >2014-01-30 04:59:18,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a221756 >2014-01-30 04:59:19,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5100f75b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@145636f9}, log id: 5a221756 >2014-01-30 04:59:19,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 54c8782c >2014-01-30 04:59:19,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 54c8782c >2014-01-30 04:59:19,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 33bf6514 >2014-01-30 04:59:19,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33bf6514 >2014-01-30 04:59:24,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a417e54 >2014-01-30 04:59:25,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3a417e54 >2014-01-30 04:59:25,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6fd558aa >2014-01-30 04:59:25,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@991e82d8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3815b6c8}, log id: 6fd558aa >2014-01-30 04:59:25,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2a31652f >2014-01-30 04:59:26,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2a31652f >2014-01-30 04:59:26,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 48fc27e9 >2014-01-30 04:59:26,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48fc27e9 >2014-01-30 04:59:31,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d5533aa >2014-01-30 04:59:31,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2d5533aa >2014-01-30 04:59:31,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36f3c0e7 >2014-01-30 04:59:32,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1da9a49, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b5ad9d3}, log id: 36f3c0e7 >2014-01-30 04:59:32,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3bab2d07 >2014-01-30 04:59:32,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3bab2d07 >2014-01-30 04:59:32,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a625576 >2014-01-30 04:59:33,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a625576 >2014-01-30 04:59:38,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7488ccbc >2014-01-30 04:59:38,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7488ccbc >2014-01-30 04:59:38,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a339cba >2014-01-30 04:59:38,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb9a1053, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8822737f}, log id: 1a339cba >2014-01-30 04:59:38,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 698258d3 >2014-01-30 04:59:39,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 698258d3 >2014-01-30 04:59:39,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 553c7a4c >2014-01-30 04:59:39,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 553c7a4c >2014-01-30 04:59:44,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a561040 >2014-01-30 04:59:45,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2a561040 >2014-01-30 04:59:45,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74cef48f >2014-01-30 04:59:45,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2af42eff, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1495cea9}, log id: 74cef48f >2014-01-30 04:59:45,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65fa1623 >2014-01-30 04:59:45,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 65fa1623 >2014-01-30 04:59:45,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 362b6995 >2014-01-30 04:59:46,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 362b6995 >2014-01-30 04:59:51,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2767769d >2014-01-30 04:59:51,331 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 04:59:51,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2767769d >2014-01-30 04:59:51,617 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 04:59:51,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1691d907 >2014-01-30 04:59:51,845 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 04:59:51,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c5276e3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d598a45}, log id: 1691d907 >2014-01-30 04:59:51,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 54d2a1ed >2014-01-30 04:59:51,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3feeb8d >2014-01-30 04:59:52,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7b04d6d9, log id: 54d2a1ed >2014-01-30 04:59:52,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 7ab57fa7 >2014-01-30 04:59:52,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3feeb8d >2014-01-30 04:59:52,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1943fa94 >2014-01-30 04:59:52,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@5c2bd0c, log id: 7ab57fa7 >2014-01-30 04:59:52,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1943fa94 >2014-01-30 04:59:57,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38129db3 >2014-01-30 04:59:58,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 38129db3 >2014-01-30 04:59:58,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49663393 >2014-01-30 04:59:58,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@645442c0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@587245dc}, log id: 49663393 >2014-01-30 04:59:58,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 55b11e5 >2014-01-30 04:59:58,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 55b11e5 >2014-01-30 04:59:58,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2d15c04 >2014-01-30 04:59:59,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d15c04 >2014-01-30 05:00:02,491 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-86) [63ec361] No up server in cluster >2014-01-30 05:00:02,491 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-86) [63ec361] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:00:02,494 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-86) [63ec361] No up server in cluster >2014-01-30 05:00:02,494 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-86) [63ec361] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:00:02,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 62d368ac >2014-01-30 05:00:03,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 62d368ac >2014-01-30 05:00:03,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1a105cc1 >2014-01-30 05:00:03,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterTasksListVDSCommand, return: [], log id: 1a105cc1 >2014-01-30 05:00:04,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 474bcdca >2014-01-30 05:00:04,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 474bcdca >2014-01-30 05:00:04,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11fce62b >2014-01-30 05:00:04,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57a98bcb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5d8c549}, log id: 11fce62b >2014-01-30 05:00:04,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 17bd368 >2014-01-30 05:00:05,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 17bd368 >2014-01-30 05:00:05,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 36f639e9 >2014-01-30 05:00:05,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36f639e9 >2014-01-30 05:00:10,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 683a83ef >2014-01-30 05:00:11,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 683a83ef >2014-01-30 05:00:11,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7fc86f6 >2014-01-30 05:00:11,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cd1ff13, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12e399d6}, log id: 7fc86f6 >2014-01-30 05:00:11,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 695d5d9e >2014-01-30 05:00:12,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 695d5d9e >2014-01-30 05:00:12,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2a35d406 >2014-01-30 05:00:12,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a35d406 >2014-01-30 05:00:17,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 456f4bba >2014-01-30 05:00:17,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 456f4bba >2014-01-30 05:00:17,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21dc8a75 >2014-01-30 05:00:18,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7febea2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97a1900f}, log id: 21dc8a75 >2014-01-30 05:00:18,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 728ea3af >2014-01-30 05:00:18,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 728ea3af >2014-01-30 05:00:18,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6dc5d18 >2014-01-30 05:00:18,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6dc5d18 >2014-01-30 05:00:23,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: bcb0754 >2014-01-30 05:00:24,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: bcb0754 >2014-01-30 05:00:24,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40a45f26 >2014-01-30 05:00:24,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2994171a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ff9f68}, log id: 40a45f26 >2014-01-30 05:00:24,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4f675e4e >2014-01-30 05:00:25,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4f675e4e >2014-01-30 05:00:25,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 22556eac >2014-01-30 05:00:25,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22556eac >2014-01-30 05:00:30,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20fae2b5 >2014-01-30 05:00:30,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 20fae2b5 >2014-01-30 05:00:30,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4fb6726c >2014-01-30 05:00:31,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58376a13, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47e9c498}, log id: 4fb6726c >2014-01-30 05:00:31,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2a48ad94 >2014-01-30 05:00:31,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2a48ad94 >2014-01-30 05:00:31,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7b16aca0 >2014-01-30 05:00:31,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b16aca0 >2014-01-30 05:00:36,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: edad3c8 >2014-01-30 05:00:37,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: edad3c8 >2014-01-30 05:00:37,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18379d9b >2014-01-30 05:00:37,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2d04bba, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5af78d9}, log id: 18379d9b >2014-01-30 05:00:37,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 21b6c502 >2014-01-30 05:00:38,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 21b6c502 >2014-01-30 05:00:38,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 724e6b90 >2014-01-30 05:00:38,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 724e6b90 >2014-01-30 05:00:43,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21519ec4 >2014-01-30 05:00:44,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 21519ec4 >2014-01-30 05:00:44,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 34be565d >2014-01-30 05:00:44,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c97fda1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be64f3a9}, log id: 34be565d >2014-01-30 05:00:44,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2e10a8a3 >2014-01-30 05:00:44,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2e10a8a3 >2014-01-30 05:00:44,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 531ac733 >2014-01-30 05:00:45,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 531ac733 >2014-01-30 05:00:50,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60d5086b >2014-01-30 05:00:50,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 60d5086b >2014-01-30 05:00:50,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11eea931 >2014-01-30 05:00:50,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82e84f15, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eca5e37b}, log id: 11eea931 >2014-01-30 05:00:50,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6f562cff >2014-01-30 05:00:51,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6f562cff >2014-01-30 05:00:51,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6f5604ce >2014-01-30 05:00:51,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f5604ce >2014-01-30 05:00:56,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36e45327 >2014-01-30 05:00:57,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 36e45327 >2014-01-30 05:00:57,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ad8f5c2 >2014-01-30 05:00:57,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e63ce47a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e9e209c}, log id: 3ad8f5c2 >2014-01-30 05:00:57,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 67148149 >2014-01-30 05:00:57,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 67148149 >2014-01-30 05:00:57,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e0ad1b >2014-01-30 05:00:58,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e0ad1b >2014-01-30 05:01:03,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f120b4 >2014-01-30 05:01:03,320 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) [992a9f] No up server in cluster >2014-01-30 05:01:03,320 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) [992a9f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:01:03,323 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) [992a9f] No up server in cluster >2014-01-30 05:01:03,324 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) [992a9f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:01:03,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 5d8a77a0 >2014-01-30 05:01:03,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: f120b4 >2014-01-30 05:01:03,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12e4ec77 >2014-01-30 05:01:03,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 5d8a77a0 >2014-01-30 05:01:03,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 4b38dc9a >2014-01-30 05:01:04,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47438fad, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45a7bd9f}, log id: 12e4ec77 >2014-01-30 05:01:04,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1d769251 >2014-01-30 05:01:04,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterTasksListVDSCommand, return: [], log id: 4b38dc9a >2014-01-30 05:01:04,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1d769251 >2014-01-30 05:01:04,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 14bf77d3 >2014-01-30 05:01:04,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14bf77d3 >2014-01-30 05:01:09,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 786f7ca >2014-01-30 05:01:10,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 786f7ca >2014-01-30 05:01:10,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65d820f6 >2014-01-30 05:01:10,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1e3c21a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9b1f92e}, log id: 65d820f6 >2014-01-30 05:01:10,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6f472c5d >2014-01-30 05:01:11,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6f472c5d >2014-01-30 05:01:11,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 383cd773 >2014-01-30 05:01:11,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 383cd773 >2014-01-30 05:01:16,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 142834b0 >2014-01-30 05:01:16,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 142834b0 >2014-01-30 05:01:16,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 63d02905 >2014-01-30 05:01:17,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19878b84, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ccf29aa}, log id: 63d02905 >2014-01-30 05:01:17,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 25785a48 >2014-01-30 05:01:17,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 25785a48 >2014-01-30 05:01:17,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5dc48734 >2014-01-30 05:01:17,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5dc48734 >2014-01-30 05:01:22,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c13be21 >2014-01-30 05:01:23,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3c13be21 >2014-01-30 05:01:23,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42dca262 >2014-01-30 05:01:23,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be24b07a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff91d756}, log id: 42dca262 >2014-01-30 05:01:23,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 40100ee0 >2014-01-30 05:01:24,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 40100ee0 >2014-01-30 05:01:24,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6870fdee >2014-01-30 05:01:24,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6870fdee >2014-01-30 05:01:29,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 149909a1 >2014-01-30 05:01:30,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 149909a1 >2014-01-30 05:01:30,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fc9bd76 >2014-01-30 05:01:30,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@186de35d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2544ba54}, log id: 3fc9bd76 >2014-01-30 05:01:30,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 46bebe99 >2014-01-30 05:01:30,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 46bebe99 >2014-01-30 05:01:30,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 22289619 >2014-01-30 05:01:31,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22289619 >2014-01-30 05:01:36,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 281edf66 >2014-01-30 05:01:36,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 281edf66 >2014-01-30 05:01:36,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e7d5afe >2014-01-30 05:01:36,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d6c6900, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd8f0d43}, log id: 6e7d5afe >2014-01-30 05:01:36,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 670cdbba >2014-01-30 05:01:37,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 670cdbba >2014-01-30 05:01:37,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 71dd1692 >2014-01-30 05:01:37,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71dd1692 >2014-01-30 05:01:42,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 503eed04 >2014-01-30 05:01:43,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 503eed04 >2014-01-30 05:01:43,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d6df411 >2014-01-30 05:01:43,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdc7907e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb9395aa}, log id: 5d6df411 >2014-01-30 05:01:43,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 47a27ad2 >2014-01-30 05:01:44,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 47a27ad2 >2014-01-30 05:01:44,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6c7eeabd >2014-01-30 05:01:44,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c7eeabd >2014-01-30 05:01:49,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24d2a18 >2014-01-30 05:01:49,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 24d2a18 >2014-01-30 05:01:49,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35e1e944 >2014-01-30 05:01:50,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4bc6ac38, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8505a13}, log id: 35e1e944 >2014-01-30 05:01:50,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6da12cbe >2014-01-30 05:01:50,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6da12cbe >2014-01-30 05:01:50,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2229e42b >2014-01-30 05:01:50,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2229e42b >2014-01-30 05:01:55,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 28f12b4a >2014-01-30 05:01:56,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 28f12b4a >2014-01-30 05:01:56,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6791822 >2014-01-30 05:01:56,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e6bcc9c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f04a897}, log id: 6791822 >2014-01-30 05:01:56,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 14715e2c >2014-01-30 05:01:57,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 14715e2c >2014-01-30 05:01:57,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 552e1b1f >2014-01-30 05:01:57,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 552e1b1f >2014-01-30 05:02:02,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 324a365a >2014-01-30 05:02:02,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 324a365a >2014-01-30 05:02:02,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9ed79e5 >2014-01-30 05:02:03,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3b6713f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8d72a17}, log id: 9ed79e5 >2014-01-30 05:02:03,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 134ced91 >2014-01-30 05:02:03,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 134ced91 >2014-01-30 05:02:03,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2bc7f8b0 >2014-01-30 05:02:03,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bc7f8b0 >2014-01-30 05:02:04,168 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-84) [2ccca513] No up server in cluster >2014-01-30 05:02:04,168 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-84) [2ccca513] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:02:04,170 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-84) [2ccca513] No up server in cluster >2014-01-30 05:02:04,170 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-84) [2ccca513] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:02:04,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b5184da >2014-01-30 05:02:04,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: b5184da >2014-01-30 05:02:04,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 24c78aeb >2014-01-30 05:02:05,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterTasksListVDSCommand, return: [], log id: 24c78aeb >2014-01-30 05:02:09,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8e61fc6 >2014-01-30 05:02:09,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 8e61fc6 >2014-01-30 05:02:09,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30eb12f2 >2014-01-30 05:02:09,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb1ebc1a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf3e2b70}, log id: 30eb12f2 >2014-01-30 05:02:09,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: e88844a >2014-01-30 05:02:10,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: e88844a >2014-01-30 05:02:10,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 37ccff >2014-01-30 05:02:10,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37ccff >2014-01-30 05:02:15,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: fc6d2e5 >2014-01-30 05:02:16,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: fc6d2e5 >2014-01-30 05:02:16,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3449e47 >2014-01-30 05:02:16,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a489e9b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41034e11}, log id: 3449e47 >2014-01-30 05:02:16,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 12ce1e22 >2014-01-30 05:02:16,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 12ce1e22 >2014-01-30 05:02:16,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5cd13c07 >2014-01-30 05:02:17,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cd13c07 >2014-01-30 05:02:22,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a598eb5 >2014-01-30 05:02:22,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3a598eb5 >2014-01-30 05:02:22,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 883e477 >2014-01-30 05:02:22,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b9fe41e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a7f3ea5}, log id: 883e477 >2014-01-30 05:02:22,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2927c155 >2014-01-30 05:02:23,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2927c155 >2014-01-30 05:02:23,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b42fcdf >2014-01-30 05:02:23,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b42fcdf >2014-01-30 05:02:28,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 754c42df >2014-01-30 05:02:29,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 754c42df >2014-01-30 05:02:29,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12396ea5 >2014-01-30 05:02:29,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@759e5b1b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48841f61}, log id: 12396ea5 >2014-01-30 05:02:29,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 91101e1 >2014-01-30 05:02:30,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 91101e1 >2014-01-30 05:02:30,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 375fc027 >2014-01-30 05:02:30,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 375fc027 >2014-01-30 05:02:35,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 178949e2 >2014-01-30 05:02:35,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 178949e2 >2014-01-30 05:02:35,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a13ffb2 >2014-01-30 05:02:36,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b311653b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33874ee6}, log id: 7a13ffb2 >2014-01-30 05:02:36,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2dbe5fc9 >2014-01-30 05:02:36,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2dbe5fc9 >2014-01-30 05:02:36,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 58c617c6 >2014-01-30 05:02:36,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58c617c6 >2014-01-30 05:02:41,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b8c393b >2014-01-30 05:02:42,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: b8c393b >2014-01-30 05:02:42,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66277726 >2014-01-30 05:02:42,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13265e09, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ea946c0}, log id: 66277726 >2014-01-30 05:02:42,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: f96885e >2014-01-30 05:02:43,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: f96885e >2014-01-30 05:02:43,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 27326872 >2014-01-30 05:02:43,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27326872 >2014-01-30 05:02:48,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a9955a2 >2014-01-30 05:02:48,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a9955a2 >2014-01-30 05:02:48,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6043cee7 >2014-01-30 05:02:49,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38e716d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0d97b10}, log id: 6043cee7 >2014-01-30 05:02:49,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 487d6bd4 >2014-01-30 05:02:49,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 487d6bd4 >2014-01-30 05:02:49,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7f2b8e7a >2014-01-30 05:02:49,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f2b8e7a >2014-01-30 05:02:54,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40b76896 >2014-01-30 05:02:55,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 40b76896 >2014-01-30 05:02:55,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b5934c6 >2014-01-30 05:02:55,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dac4eadf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30a9ca29}, log id: 5b5934c6 >2014-01-30 05:02:55,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 11e667ba >2014-01-30 05:02:56,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 11e667ba >2014-01-30 05:02:56,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 75cf3f2f >2014-01-30 05:02:56,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75cf3f2f >2014-01-30 05:03:01,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7cf7bf60 >2014-01-30 05:03:02,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7cf7bf60 >2014-01-30 05:03:02,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35462eb2 >2014-01-30 05:03:02,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e984ccf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@161a389c}, log id: 35462eb2 >2014-01-30 05:03:02,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6dd6a8a7 >2014-01-30 05:03:02,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6dd6a8a7 >2014-01-30 05:03:02,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7f919191 >2014-01-30 05:03:03,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f919191 >2014-01-30 05:03:05,027 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) [68161e48] No up server in cluster >2014-01-30 05:03:05,027 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) [68161e48] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:03:05,031 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) [68161e48] No up server in cluster >2014-01-30 05:03:05,031 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) [68161e48] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:03:05,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 552084dc >2014-01-30 05:03:05,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 552084dc >2014-01-30 05:03:05,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 2b939ff0 >2014-01-30 05:03:05,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterTasksListVDSCommand, return: [], log id: 2b939ff0 >2014-01-30 05:03:08,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e123eb4 >2014-01-30 05:03:08,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1e123eb4 >2014-01-30 05:03:08,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2499d2f3 >2014-01-30 05:03:08,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e1a9309, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@959d2318}, log id: 2499d2f3 >2014-01-30 05:03:08,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ba0c770 >2014-01-30 05:03:09,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3ba0c770 >2014-01-30 05:03:09,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 15c63bcb >2014-01-30 05:03:09,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15c63bcb >2014-01-30 05:03:14,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c55b8ab >2014-01-30 05:03:15,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5c55b8ab >2014-01-30 05:03:15,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54425489 >2014-01-30 05:03:15,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d52291c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa067c2c}, log id: 54425489 >2014-01-30 05:03:15,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: f2dd37f >2014-01-30 05:03:15,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: f2dd37f >2014-01-30 05:03:15,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 46e9c85d >2014-01-30 05:03:16,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46e9c85d >2014-01-30 05:03:21,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d41f4e0 >2014-01-30 05:03:21,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3d41f4e0 >2014-01-30 05:03:21,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44ef1a93 >2014-01-30 05:03:21,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@641332a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52ce53d6}, log id: 44ef1a93 >2014-01-30 05:03:21,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5e6aa76b >2014-01-30 05:03:22,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5e6aa76b >2014-01-30 05:03:22,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 667e2aa7 >2014-01-30 05:03:22,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 667e2aa7 >2014-01-30 05:03:27,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d19322c >2014-01-30 05:03:28,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7d19322c >2014-01-30 05:03:28,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f441ed8 >2014-01-30 05:03:28,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57218e93, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21b2849b}, log id: f441ed8 >2014-01-30 05:03:28,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6c4101ff >2014-01-30 05:03:29,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6c4101ff >2014-01-30 05:03:29,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6d7f5b99 >2014-01-30 05:03:29,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d7f5b99 >2014-01-30 05:03:34,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4cebd2d3 >2014-01-30 05:03:34,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4cebd2d3 >2014-01-30 05:03:34,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d7b0b5f >2014-01-30 05:03:35,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@919f0a9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@759c1922}, log id: d7b0b5f >2014-01-30 05:03:35,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3e6daece >2014-01-30 05:03:35,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3e6daece >2014-01-30 05:03:35,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5e15bc35 >2014-01-30 05:03:35,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e15bc35 >2014-01-30 05:03:40,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ce3088d >2014-01-30 05:03:41,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4ce3088d >2014-01-30 05:03:41,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6387b8b5 >2014-01-30 05:03:41,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6dcb60b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9c14849}, log id: 6387b8b5 >2014-01-30 05:03:41,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5afd36c8 >2014-01-30 05:03:42,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5afd36c8 >2014-01-30 05:03:42,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6fdf0349 >2014-01-30 05:03:42,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fdf0349 >2014-01-30 05:03:47,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60d8758 >2014-01-30 05:03:47,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 60d8758 >2014-01-30 05:03:47,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2813a88 >2014-01-30 05:03:48,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7784948, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c864518d}, log id: 2813a88 >2014-01-30 05:03:48,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5656901b >2014-01-30 05:03:48,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5656901b >2014-01-30 05:03:48,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 11ca4678 >2014-01-30 05:03:48,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11ca4678 >2014-01-30 05:03:53,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60d5177b >2014-01-30 05:03:54,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 60d5177b >2014-01-30 05:03:54,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5be7b315 >2014-01-30 05:03:54,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f39feab, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c735cbf}, log id: 5be7b315 >2014-01-30 05:03:54,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6c05648f >2014-01-30 05:03:55,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6c05648f >2014-01-30 05:03:55,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 22ee1479 >2014-01-30 05:03:55,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22ee1479 >2014-01-30 05:04:00,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: dfdda43 >2014-01-30 05:04:01,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: dfdda43 >2014-01-30 05:04:01,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e5521b6 >2014-01-30 05:04:01,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f54edb0d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d53f68c3}, log id: 4e5521b6 >2014-01-30 05:04:01,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 54bebf88 >2014-01-30 05:04:01,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 54bebf88 >2014-01-30 05:04:01,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6c9be3db >2014-01-30 05:04:02,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c9be3db >2014-01-30 05:04:05,883 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) [5049497] No up server in cluster >2014-01-30 05:04:05,884 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) [5049497] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:04:05,887 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) [5049497] No up server in cluster >2014-01-30 05:04:05,887 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) [5049497] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:04:05,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 3203828c >2014-01-30 05:04:06,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 3203828c >2014-01-30 05:04:06,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2063d660 >2014-01-30 05:04:06,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterTasksListVDSCommand, return: [], log id: 2063d660 >2014-01-30 05:04:07,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: dab77e5 >2014-01-30 05:04:07,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: dab77e5 >2014-01-30 05:04:07,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18057a56 >2014-01-30 05:04:07,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4cc31a8e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0fa7aba}, log id: 18057a56 >2014-01-30 05:04:07,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: f1bf9ab >2014-01-30 05:04:08,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: f1bf9ab >2014-01-30 05:04:08,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5e0c86a9 >2014-01-30 05:04:08,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e0c86a9 >2014-01-30 05:04:13,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d068642 >2014-01-30 05:04:14,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2d068642 >2014-01-30 05:04:14,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29d3a51d >2014-01-30 05:04:14,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73ac192, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95b1c0e}, log id: 29d3a51d >2014-01-30 05:04:14,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3d1141de >2014-01-30 05:04:14,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3d1141de >2014-01-30 05:04:14,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 136b23e0 >2014-01-30 05:04:15,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 136b23e0 >2014-01-30 05:04:20,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 632b6d64 >2014-01-30 05:04:20,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 632b6d64 >2014-01-30 05:04:20,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b421a06 >2014-01-30 05:04:21,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a788f53, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86e280f3}, log id: 7b421a06 >2014-01-30 05:04:21,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6537086e >2014-01-30 05:04:21,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6537086e >2014-01-30 05:04:21,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c254396 >2014-01-30 05:04:21,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c254396 >2014-01-30 05:04:26,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 781f981f >2014-01-30 05:04:27,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 781f981f >2014-01-30 05:04:27,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7281ac6f >2014-01-30 05:04:27,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8225367a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c2d5542}, log id: 7281ac6f >2014-01-30 05:04:27,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 238a5643 >2014-01-30 05:04:28,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 238a5643 >2014-01-30 05:04:28,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 56087615 >2014-01-30 05:04:28,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56087615 >2014-01-30 05:04:33,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d9ac685 >2014-01-30 05:04:33,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: d9ac685 >2014-01-30 05:04:33,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1450c275 >2014-01-30 05:04:34,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8e0d868, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dae90a9}, log id: 1450c275 >2014-01-30 05:04:34,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 381e6bd5 >2014-01-30 05:04:34,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 381e6bd5 >2014-01-30 05:04:34,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 45102d47 >2014-01-30 05:04:34,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45102d47 >2014-01-30 05:04:39,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a5b4463 >2014-01-30 05:04:40,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4a5b4463 >2014-01-30 05:04:40,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6fd7f2d8 >2014-01-30 05:04:40,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6372275, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad173751}, log id: 6fd7f2d8 >2014-01-30 05:04:40,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ddbda1a >2014-01-30 05:04:41,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6ddbda1a >2014-01-30 05:04:41,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2fe02bf7 >2014-01-30 05:04:41,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2fe02bf7 >2014-01-30 05:04:46,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 677ba0c1 >2014-01-30 05:04:46,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 677ba0c1 >2014-01-30 05:04:47,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 110b7bf9 >2014-01-30 05:04:47,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c2daa5f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbe515db}, log id: 110b7bf9 >2014-01-30 05:04:47,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2395ba88 >2014-01-30 05:04:47,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2395ba88 >2014-01-30 05:04:47,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 139bd510 >2014-01-30 05:04:48,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 139bd510 >2014-01-30 05:04:52,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 2532b74 >2014-01-30 05:04:52,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@12aff281, log id: 2532b74 >2014-01-30 05:04:52,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 5d59fcbc >2014-01-30 05:04:53,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7ee9d8c6, log id: 5d59fcbc >2014-01-30 05:04:53,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18dc5d99 >2014-01-30 05:04:53,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 18dc5d99 >2014-01-30 05:04:53,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72af2b55 >2014-01-30 05:04:53,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94da2de5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a7fb223}, log id: 72af2b55 >2014-01-30 05:04:53,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 66c1a3c6 >2014-01-30 05:04:54,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 66c1a3c6 >2014-01-30 05:04:54,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 43b10c5e >2014-01-30 05:04:54,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43b10c5e >2014-01-30 05:04:59,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69f0e442 >2014-01-30 05:05:00,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 69f0e442 >2014-01-30 05:05:00,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30f68738 >2014-01-30 05:05:00,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f864ade, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@add8ef0d}, log id: 30f68738 >2014-01-30 05:05:00,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4003aa41 >2014-01-30 05:05:00,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4003aa41 >2014-01-30 05:05:00,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: fb015b5 >2014-01-30 05:05:01,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fb015b5 >2014-01-30 05:05:06,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35f0f0c4 >2014-01-30 05:05:06,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 35f0f0c4 >2014-01-30 05:05:06,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 95f02e4 >2014-01-30 05:05:06,729 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-76) [5b01de2c] No up server in cluster >2014-01-30 05:05:06,729 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-76) [5b01de2c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:05:06,732 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-76) [5b01de2c] No up server in cluster >2014-01-30 05:05:06,732 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-76) [5b01de2c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:05:06,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 4838af6 >2014-01-30 05:05:06,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee5bd725, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@afa544d9}, log id: 95f02e4 >2014-01-30 05:05:06,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1de83943 >2014-01-30 05:05:07,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4838af6 >2014-01-30 05:05:07,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 7cf896b5 >2014-01-30 05:05:07,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1de83943 >2014-01-30 05:05:07,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b9a06ef >2014-01-30 05:05:07,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterTasksListVDSCommand, return: [], log id: 7cf896b5 >2014-01-30 05:05:07,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b9a06ef >2014-01-30 05:05:12,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16d549c8 >2014-01-30 05:05:13,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 16d549c8 >2014-01-30 05:05:13,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fd9ad81 >2014-01-30 05:05:13,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7f417d4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@601a62c4}, log id: 3fd9ad81 >2014-01-30 05:05:13,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 409f1543 >2014-01-30 05:05:13,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 409f1543 >2014-01-30 05:05:13,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ef38684 >2014-01-30 05:05:14,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ef38684 >2014-01-30 05:05:19,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 586805ac >2014-01-30 05:05:19,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 586805ac >2014-01-30 05:05:19,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2eb88883 >2014-01-30 05:05:19,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fabe30ee, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5699847e}, log id: 2eb88883 >2014-01-30 05:05:20,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 76d8b5c8 >2014-01-30 05:05:20,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 76d8b5c8 >2014-01-30 05:05:20,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6d90bdca >2014-01-30 05:05:20,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d90bdca >2014-01-30 05:05:25,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2457937 >2014-01-30 05:05:26,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2457937 >2014-01-30 05:05:26,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1435127b >2014-01-30 05:05:26,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d3b036d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4dfedeb}, log id: 1435127b >2014-01-30 05:05:26,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5d283e0b >2014-01-30 05:05:27,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5d283e0b >2014-01-30 05:05:27,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4ac5d84a >2014-01-30 05:05:27,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ac5d84a >2014-01-30 05:05:32,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12182b9c >2014-01-30 05:05:32,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 12182b9c >2014-01-30 05:05:32,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 321db271 >2014-01-30 05:05:33,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@238f2408, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd6e8786}, log id: 321db271 >2014-01-30 05:05:33,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ebaec2c >2014-01-30 05:05:33,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: ebaec2c >2014-01-30 05:05:33,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 27de60ca >2014-01-30 05:05:33,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27de60ca >2014-01-30 05:05:38,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38afdb9f >2014-01-30 05:05:39,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 38afdb9f >2014-01-30 05:05:39,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b16f936 >2014-01-30 05:05:39,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@206a3400, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b488f85}, log id: 4b16f936 >2014-01-30 05:05:39,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: f19b02d >2014-01-30 05:05:40,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: f19b02d >2014-01-30 05:05:40,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5bc85ce6 >2014-01-30 05:05:40,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5bc85ce6 >2014-01-30 05:05:45,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32de95f5 >2014-01-30 05:05:45,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 32de95f5 >2014-01-30 05:05:45,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d164ae5 >2014-01-30 05:05:46,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea420599, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6110a361}, log id: 3d164ae5 >2014-01-30 05:05:46,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d1deb06 >2014-01-30 05:05:46,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7d1deb06 >2014-01-30 05:05:46,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 33430a11 >2014-01-30 05:05:47,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33430a11 >2014-01-30 05:05:52,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ca599f6 >2014-01-30 05:05:52,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2ca599f6 >2014-01-30 05:05:52,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52766980 >2014-01-30 05:05:52,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6490ff6b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b787181}, log id: 52766980 >2014-01-30 05:05:52,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 595c53b2 >2014-01-30 05:05:53,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 595c53b2 >2014-01-30 05:05:53,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77031e2d >2014-01-30 05:05:53,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77031e2d >2014-01-30 05:05:58,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6fbfcadf >2014-01-30 05:05:59,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6fbfcadf >2014-01-30 05:05:59,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c467d1d >2014-01-30 05:05:59,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@386f3c44, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75d90230}, log id: 5c467d1d >2014-01-30 05:05:59,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5e1e1665 >2014-01-30 05:05:59,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5e1e1665 >2014-01-30 05:05:59,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d867c75 >2014-01-30 05:06:00,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d867c75 >2014-01-30 05:06:05,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37e3abd6 >2014-01-30 05:06:05,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 37e3abd6 >2014-01-30 05:06:05,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 349beb40 >2014-01-30 05:06:05,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc04f529, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3accc652}, log id: 349beb40 >2014-01-30 05:06:05,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 61b03b99 >2014-01-30 05:06:06,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 61b03b99 >2014-01-30 05:06:06,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e286b73 >2014-01-30 05:06:06,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e286b73 >2014-01-30 05:06:07,462 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] No up server in cluster >2014-01-30 05:06:07,462 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:06:07,465 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] No up server in cluster >2014-01-30 05:06:07,466 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:06:07,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3daa3bdd >2014-01-30 05:06:08,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 3daa3bdd >2014-01-30 05:06:08,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 14c6d5d8 >2014-01-30 05:06:08,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterTasksListVDSCommand, return: [], log id: 14c6d5d8 >2014-01-30 05:06:11,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1033a71 >2014-01-30 05:06:12,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1033a71 >2014-01-30 05:06:12,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8ef351c >2014-01-30 05:06:12,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15acf188, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de0b3142}, log id: 8ef351c >2014-01-30 05:06:12,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2fba1921 >2014-01-30 05:06:12,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2fba1921 >2014-01-30 05:06:12,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 601e3e54 >2014-01-30 05:06:13,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 601e3e54 >2014-01-30 05:06:18,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 112b8c86 >2014-01-30 05:06:18,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 112b8c86 >2014-01-30 05:06:18,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3080eb0a >2014-01-30 05:06:19,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e91b98da, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6878abe}, log id: 3080eb0a >2014-01-30 05:06:19,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65e47e1b >2014-01-30 05:06:19,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 65e47e1b >2014-01-30 05:06:19,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 29483529 >2014-01-30 05:06:19,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29483529 >2014-01-30 05:06:24,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c543e4c >2014-01-30 05:06:25,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1c543e4c >2014-01-30 05:06:25,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e33cefa >2014-01-30 05:06:25,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8147b132, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d4b1a4a}, log id: 5e33cefa >2014-01-30 05:06:25,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 157c2c38 >2014-01-30 05:06:26,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 157c2c38 >2014-01-30 05:06:26,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 42b7de26 >2014-01-30 05:06:26,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42b7de26 >2014-01-30 05:06:31,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 266f9d65 >2014-01-30 05:06:31,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 266f9d65 >2014-01-30 05:06:31,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40220d6c >2014-01-30 05:06:32,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9b2a048, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd6bb03a}, log id: 40220d6c >2014-01-30 05:06:32,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6923e0a3 >2014-01-30 05:06:32,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6923e0a3 >2014-01-30 05:06:32,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4fb84473 >2014-01-30 05:06:32,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fb84473 >2014-01-30 05:06:37,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a51546 >2014-01-30 05:06:38,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7a51546 >2014-01-30 05:06:38,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f8b407a >2014-01-30 05:06:38,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e4d952c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d5eaf61}, log id: 1f8b407a >2014-01-30 05:06:38,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5fe79029 >2014-01-30 05:06:39,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5fe79029 >2014-01-30 05:06:39,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 39cf2c45 >2014-01-30 05:06:39,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39cf2c45 >2014-01-30 05:06:44,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 323ef3b0 >2014-01-30 05:06:44,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 323ef3b0 >2014-01-30 05:06:44,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43563a9f >2014-01-30 05:06:45,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a7932d9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85dca4ac}, log id: 43563a9f >2014-01-30 05:06:45,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 78d93312 >2014-01-30 05:06:45,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 78d93312 >2014-01-30 05:06:45,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6e367498 >2014-01-30 05:06:45,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e367498 >2014-01-30 05:06:50,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a0dd10d >2014-01-30 05:06:51,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a0dd10d >2014-01-30 05:06:51,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 157b1f80 >2014-01-30 05:06:51,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87e52159, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@376fb6ed}, log id: 157b1f80 >2014-01-30 05:06:51,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 70550e9b >2014-01-30 05:06:52,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 70550e9b >2014-01-30 05:06:52,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 433200f0 >2014-01-30 05:06:52,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 433200f0 >2014-01-30 05:06:57,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50c13a4c >2014-01-30 05:06:57,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 50c13a4c >2014-01-30 05:06:57,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 225d7594 >2014-01-30 05:06:58,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dbc60953, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b17a275e}, log id: 225d7594 >2014-01-30 05:06:58,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 69f6be35 >2014-01-30 05:06:58,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 69f6be35 >2014-01-30 05:06:58,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5f51b51b >2014-01-30 05:06:59,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f51b51b >2014-01-30 05:07:04,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d606761 >2014-01-30 05:07:04,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: d606761 >2014-01-30 05:07:04,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1eb56b30 >2014-01-30 05:07:04,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a583a33, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a26d881b}, log id: 1eb56b30 >2014-01-30 05:07:04,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 690c1fbc >2014-01-30 05:07:05,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 690c1fbc >2014-01-30 05:07:05,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 34a5bd0a >2014-01-30 05:07:05,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34a5bd0a >2014-01-30 05:07:08,291 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-39) No up server in cluster >2014-01-30 05:07:08,292 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-39) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:07:08,295 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-39) No up server in cluster >2014-01-30 05:07:08,295 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-39) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:07:08,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 3b964e >2014-01-30 05:07:08,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 3b964e >2014-01-30 05:07:08,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2900391c >2014-01-30 05:07:09,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2900391c >2014-01-30 05:07:10,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5bf7dedd >2014-01-30 05:07:11,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5bf7dedd >2014-01-30 05:07:11,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 238e4192 >2014-01-30 05:07:11,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16a96ff2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86da91c9}, log id: 238e4192 >2014-01-30 05:07:11,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5372e9ac >2014-01-30 05:07:11,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5372e9ac >2014-01-30 05:07:11,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 40f4406d >2014-01-30 05:07:12,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40f4406d >2014-01-30 05:07:17,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a34ad86 >2014-01-30 05:07:17,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1a34ad86 >2014-01-30 05:07:17,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11eb2aac >2014-01-30 05:07:18,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cc89aa0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d5ee816}, log id: 11eb2aac >2014-01-30 05:07:18,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 695015a9 >2014-01-30 05:07:18,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 695015a9 >2014-01-30 05:07:18,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3f208e1e >2014-01-30 05:07:18,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f208e1e >2014-01-30 05:07:23,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d658471 >2014-01-30 05:07:24,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2d658471 >2014-01-30 05:07:24,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d91891b >2014-01-30 05:07:24,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2d1c57c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28d31c8c}, log id: 5d91891b >2014-01-30 05:07:24,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 338a0704 >2014-01-30 05:07:25,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 338a0704 >2014-01-30 05:07:25,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: db4721f >2014-01-30 05:07:25,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: db4721f >2014-01-30 05:07:30,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 397caab2 >2014-01-30 05:07:30,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 397caab2 >2014-01-30 05:07:30,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ba1a1d7 >2014-01-30 05:07:31,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aef9a7e2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1aec5d1d}, log id: 3ba1a1d7 >2014-01-30 05:07:31,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3fffbeb5 >2014-01-30 05:07:31,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3fffbeb5 >2014-01-30 05:07:31,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 49acf590 >2014-01-30 05:07:31,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49acf590 >2014-01-30 05:07:36,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 641fc59 >2014-01-30 05:07:37,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 641fc59 >2014-01-30 05:07:37,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31def0df >2014-01-30 05:07:37,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87b89a98, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d168ec}, log id: 31def0df >2014-01-30 05:07:37,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 15e7af6a >2014-01-30 05:07:38,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 15e7af6a >2014-01-30 05:07:38,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 28c5dc44 >2014-01-30 05:07:38,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28c5dc44 >2014-01-30 05:07:43,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e661dc2 >2014-01-30 05:07:44,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1e661dc2 >2014-01-30 05:07:44,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 199bb4aa >2014-01-30 05:07:44,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@283be1b5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47dc42fe}, log id: 199bb4aa >2014-01-30 05:07:44,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7eba159e >2014-01-30 05:07:44,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7eba159e >2014-01-30 05:07:44,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 8b46a34 >2014-01-30 05:07:45,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8b46a34 >2014-01-30 05:07:50,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 417bbe3 >2014-01-30 05:07:50,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 417bbe3 >2014-01-30 05:07:50,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 39faf362 >2014-01-30 05:07:50,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@499011a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19e4273f}, log id: 39faf362 >2014-01-30 05:07:50,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6de9a80c >2014-01-30 05:07:51,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6de9a80c >2014-01-30 05:07:51,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4f84d07f >2014-01-30 05:07:51,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f84d07f >2014-01-30 05:07:56,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25e9d21e >2014-01-30 05:07:57,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 25e9d21e >2014-01-30 05:07:57,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17bfeee6 >2014-01-30 05:07:57,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8383378b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7369451e}, log id: 17bfeee6 >2014-01-30 05:07:57,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 833fbd >2014-01-30 05:07:57,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 833fbd >2014-01-30 05:07:57,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6507cd48 >2014-01-30 05:07:58,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6507cd48 >2014-01-30 05:08:03,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f15e56c >2014-01-30 05:08:03,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5f15e56c >2014-01-30 05:08:03,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 727b40d6 >2014-01-30 05:08:03,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4528f899, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9260bdc4}, log id: 727b40d6 >2014-01-30 05:08:04,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5606719b >2014-01-30 05:08:04,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5606719b >2014-01-30 05:08:04,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5b3993 >2014-01-30 05:08:04,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b3993 >2014-01-30 05:08:09,137 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2014-01-30 05:08:09,138 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:08:09,141 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2014-01-30 05:08:09,141 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:08:09,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 410d538d >2014-01-30 05:08:09,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 410d538d >2014-01-30 05:08:09,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 31f98b5b >2014-01-30 05:08:09,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a5e2688 >2014-01-30 05:08:09,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [], log id: 31f98b5b >2014-01-30 05:08:10,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7a5e2688 >2014-01-30 05:08:10,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6616cbf >2014-01-30 05:08:10,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c5003c1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e71973b}, log id: 6616cbf >2014-01-30 05:08:10,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: fc8e41 >2014-01-30 05:08:11,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: fc8e41 >2014-01-30 05:08:11,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 17bfdd6c >2014-01-30 05:08:11,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17bfdd6c >2014-01-30 05:08:16,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12e2a431 >2014-01-30 05:08:16,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 12e2a431 >2014-01-30 05:08:16,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3de28ba2 >2014-01-30 05:08:17,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43bbccbf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8599038f}, log id: 3de28ba2 >2014-01-30 05:08:17,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1213d15 >2014-01-30 05:08:17,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1213d15 >2014-01-30 05:08:17,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7e95c4a >2014-01-30 05:08:17,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e95c4a >2014-01-30 05:08:22,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18b44d89 >2014-01-30 05:08:23,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 18b44d89 >2014-01-30 05:08:23,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d51be10 >2014-01-30 05:08:23,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee96ea48, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62ac2f6b}, log id: 6d51be10 >2014-01-30 05:08:23,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 297e3b23 >2014-01-30 05:08:24,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 297e3b23 >2014-01-30 05:08:24,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 26ce8eac >2014-01-30 05:08:24,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26ce8eac >2014-01-30 05:08:29,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d417146 >2014-01-30 05:08:29,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4d417146 >2014-01-30 05:08:29,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4daf9a2d >2014-01-30 05:08:30,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57a0c1d6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1bea0953}, log id: 4daf9a2d >2014-01-30 05:08:30,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 726e489c >2014-01-30 05:08:30,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 726e489c >2014-01-30 05:08:30,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4cb844c0 >2014-01-30 05:08:30,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4cb844c0 >2014-01-30 05:08:36,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ff41e1 >2014-01-30 05:08:36,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1ff41e1 >2014-01-30 05:08:36,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a2e6c8f >2014-01-30 05:08:36,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce0e6641, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aebd9051}, log id: a2e6c8f >2014-01-30 05:08:36,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7f714237 >2014-01-30 05:08:37,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7f714237 >2014-01-30 05:08:37,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 667989ab >2014-01-30 05:08:37,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 667989ab >2014-01-30 05:08:42,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1035079c >2014-01-30 05:08:43,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1035079c >2014-01-30 05:08:43,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11ffb52c >2014-01-30 05:08:43,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39ee0608, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@159196e1}, log id: 11ffb52c >2014-01-30 05:08:43,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4b77e0a >2014-01-30 05:08:43,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4b77e0a >2014-01-30 05:08:43,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 626c46ae >2014-01-30 05:08:44,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 626c46ae >2014-01-30 05:08:49,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7dc4f6b8 >2014-01-30 05:08:49,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7dc4f6b8 >2014-01-30 05:08:49,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e98b1f0 >2014-01-30 05:08:49,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e69893e1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bc56539}, log id: 2e98b1f0 >2014-01-30 05:08:49,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 50259992 >2014-01-30 05:08:50,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 50259992 >2014-01-30 05:08:50,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 79ffa9f3 >2014-01-30 05:08:50,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79ffa9f3 >2014-01-30 05:08:55,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4fd88e6 >2014-01-30 05:08:56,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4fd88e6 >2014-01-30 05:08:56,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5dc6890f >2014-01-30 05:08:56,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e86f160, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81d6c28}, log id: 5dc6890f >2014-01-30 05:08:56,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 10bc82f1 >2014-01-30 05:08:56,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 10bc82f1 >2014-01-30 05:08:56,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1af1a3ef >2014-01-30 05:08:57,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1af1a3ef >2014-01-30 05:09:02,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66ef7d68 >2014-01-30 05:09:02,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 66ef7d68 >2014-01-30 05:09:02,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41506d64 >2014-01-30 05:09:03,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e624e828, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60b05358}, log id: 41506d64 >2014-01-30 05:09:03,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 48cec1ba >2014-01-30 05:09:03,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 48cec1ba >2014-01-30 05:09:03,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7303b03d >2014-01-30 05:09:03,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7303b03d >2014-01-30 05:09:08,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6bc943e3 >2014-01-30 05:09:09,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6bc943e3 >2014-01-30 05:09:09,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66638678 >2014-01-30 05:09:09,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8592d59, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c067a35}, log id: 66638678 >2014-01-30 05:09:09,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 665e2c38 >2014-01-30 05:09:09,978 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-21) [3dfe147] No up server in cluster >2014-01-30 05:09:09,978 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-21) [3dfe147] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:09:09,981 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-21) [3dfe147] No up server in cluster >2014-01-30 05:09:09,981 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-21) [3dfe147] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:09:09,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 6fdd7034 >2014-01-30 05:09:10,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 665e2c38 >2014-01-30 05:09:10,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 113ac56f >2014-01-30 05:09:10,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 113ac56f >2014-01-30 05:09:10,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 6fdd7034 >2014-01-30 05:09:10,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 192b9d0a >2014-01-30 05:09:10,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterTasksListVDSCommand, return: [], log id: 192b9d0a >2014-01-30 05:09:15,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d84afe3 >2014-01-30 05:09:15,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6d84afe3 >2014-01-30 05:09:15,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4874eab9 >2014-01-30 05:09:16,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4084a6ca, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d80da281}, log id: 4874eab9 >2014-01-30 05:09:16,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2f1cf13b >2014-01-30 05:09:16,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2f1cf13b >2014-01-30 05:09:16,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 45f4be4 >2014-01-30 05:09:16,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45f4be4 >2014-01-30 05:09:21,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d3e581e >2014-01-30 05:09:22,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3d3e581e >2014-01-30 05:09:22,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2fa9d223 >2014-01-30 05:09:22,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2e4d2b5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@266cb3e4}, log id: 2fa9d223 >2014-01-30 05:09:22,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 54199783 >2014-01-30 05:09:23,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 54199783 >2014-01-30 05:09:23,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4d4b1c89 >2014-01-30 05:09:23,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d4b1c89 >2014-01-30 05:09:28,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7baf9ba0 >2014-01-30 05:09:28,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7baf9ba0 >2014-01-30 05:09:28,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b14501e >2014-01-30 05:09:29,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a500769, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f8f0ad3}, log id: 7b14501e >2014-01-30 05:09:29,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: eb46bc0 >2014-01-30 05:09:29,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: eb46bc0 >2014-01-30 05:09:29,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 12b1fc95 >2014-01-30 05:09:29,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12b1fc95 >2014-01-30 05:09:35,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7785d230 >2014-01-30 05:09:35,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7785d230 >2014-01-30 05:09:35,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 88ace98 >2014-01-30 05:09:35,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4129a23c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db1703d8}, log id: 88ace98 >2014-01-30 05:09:35,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 68f31beb >2014-01-30 05:09:36,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 68f31beb >2014-01-30 05:09:36,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 639bd940 >2014-01-30 05:09:36,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 639bd940 >2014-01-30 05:09:41,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 691b2dff >2014-01-30 05:09:42,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 691b2dff >2014-01-30 05:09:42,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7266ff3c >2014-01-30 05:09:42,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@baf5f8f5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f7d3f9b}, log id: 7266ff3c >2014-01-30 05:09:42,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 70338821 >2014-01-30 05:09:42,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 70338821 >2014-01-30 05:09:42,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: c51a180 >2014-01-30 05:09:43,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c51a180 >2014-01-30 05:09:48,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7dd20758 >2014-01-30 05:09:48,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7dd20758 >2014-01-30 05:09:48,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: de72c68 >2014-01-30 05:09:48,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@551fe433, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24fa94c4}, log id: de72c68 >2014-01-30 05:09:48,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1585a149 >2014-01-30 05:09:49,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1585a149 >2014-01-30 05:09:49,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5ab3d676 >2014-01-30 05:09:49,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ab3d676 >2014-01-30 05:09:53,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 14ab2179 >2014-01-30 05:09:53,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@36367c9b, log id: 14ab2179 >2014-01-30 05:09:53,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 332ebfeb >2014-01-30 05:09:53,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2d75d401, log id: 332ebfeb >2014-01-30 05:09:54,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ae6d1bf >2014-01-30 05:09:55,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7ae6d1bf >2014-01-30 05:09:55,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65f22a4a >2014-01-30 05:09:55,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ffe6a8c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f47ebc8a}, log id: 65f22a4a >2014-01-30 05:09:55,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5bc27f6c >2014-01-30 05:09:56,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5bc27f6c >2014-01-30 05:09:56,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e726a3b >2014-01-30 05:09:56,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e726a3b >2014-01-30 05:10:01,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a58dd30 >2014-01-30 05:10:01,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6a58dd30 >2014-01-30 05:10:01,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7defac56 >2014-01-30 05:10:02,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd797c1c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f44e6ad5}, log id: 7defac56 >2014-01-30 05:10:02,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 10f49ebe >2014-01-30 05:10:02,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 10f49ebe >2014-01-30 05:10:02,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: b698124 >2014-01-30 05:10:02,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b698124 >2014-01-30 05:10:07,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44d4b7 >2014-01-30 05:10:08,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 44d4b7 >2014-01-30 05:10:08,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37ce4404 >2014-01-30 05:10:08,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d96f82d4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6acd8b0}, log id: 37ce4404 >2014-01-30 05:10:08,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 128e83f1 >2014-01-30 05:10:09,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 128e83f1 >2014-01-30 05:10:09,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 33936cde >2014-01-30 05:10:09,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33936cde >2014-01-30 05:10:10,790 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-2) [237643cb] No up server in cluster >2014-01-30 05:10:10,790 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-2) [237643cb] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:10:10,794 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-2) [237643cb] No up server in cluster >2014-01-30 05:10:10,794 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-2) [237643cb] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:10:10,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 2a331c58 >2014-01-30 05:10:11,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 2a331c58 >2014-01-30 05:10:11,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 23fc43a0 >2014-01-30 05:10:11,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterTasksListVDSCommand, return: [], log id: 23fc43a0 >2014-01-30 05:10:14,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 478c7a7d >2014-01-30 05:10:15,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 478c7a7d >2014-01-30 05:10:15,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d913d59 >2014-01-30 05:10:15,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56c582d3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3e6824b}, log id: 4d913d59 >2014-01-30 05:10:15,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7b4f281c >2014-01-30 05:10:15,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7b4f281c >2014-01-30 05:10:15,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 68215dbe >2014-01-30 05:10:16,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68215dbe >2014-01-30 05:10:21,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 375338eb >2014-01-30 05:10:21,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 375338eb >2014-01-30 05:10:21,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 73f32a5f >2014-01-30 05:10:21,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@baad5725, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e8877da}, log id: 73f32a5f >2014-01-30 05:10:21,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 72288358 >2014-01-30 05:10:22,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 72288358 >2014-01-30 05:10:22,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5d0f29c3 >2014-01-30 05:10:22,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d0f29c3 >2014-01-30 05:10:27,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 622fa0c >2014-01-30 05:10:28,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 622fa0c >2014-01-30 05:10:28,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f981305 >2014-01-30 05:10:28,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1d2df27, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73e690d9}, log id: 2f981305 >2014-01-30 05:10:28,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3a976bfb >2014-01-30 05:10:28,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3a976bfb >2014-01-30 05:10:28,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 532ce89a >2014-01-30 05:10:29,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 532ce89a >2014-01-30 05:10:34,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c247924 >2014-01-30 05:10:34,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c247924 >2014-01-30 05:10:34,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ca72c0f >2014-01-30 05:10:34,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bd3484b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1894b933}, log id: 7ca72c0f >2014-01-30 05:10:34,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1d2362da >2014-01-30 05:10:35,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1d2362da >2014-01-30 05:10:35,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 16145fca >2014-01-30 05:10:35,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16145fca >2014-01-30 05:10:40,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d909b7f >2014-01-30 05:10:41,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7d909b7f >2014-01-30 05:10:41,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68b96a70 >2014-01-30 05:10:41,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f44bc1b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e5d8808}, log id: 68b96a70 >2014-01-30 05:10:41,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6926cc78 >2014-01-30 05:10:42,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6926cc78 >2014-01-30 05:10:42,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: b8d88b1 >2014-01-30 05:10:42,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b8d88b1 >2014-01-30 05:10:47,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12d555d7 >2014-01-30 05:10:47,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 12d555d7 >2014-01-30 05:10:47,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6460c889 >2014-01-30 05:10:48,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36d1e32a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14082eb9}, log id: 6460c889 >2014-01-30 05:10:48,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 18398927 >2014-01-30 05:10:48,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 18398927 >2014-01-30 05:10:48,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 441364c5 >2014-01-30 05:10:48,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 441364c5 >2014-01-30 05:10:53,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50c860fe >2014-01-30 05:10:54,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 50c860fe >2014-01-30 05:10:54,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4499df05 >2014-01-30 05:10:54,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@736fad06, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0e6dfe4}, log id: 4499df05 >2014-01-30 05:10:54,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 62e1ae60 >2014-01-30 05:10:55,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 62e1ae60 >2014-01-30 05:10:55,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 281db940 >2014-01-30 05:10:55,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 281db940 >2014-01-30 05:11:00,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60031534 >2014-01-30 05:11:00,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 60031534 >2014-01-30 05:11:00,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1fcd19f2 >2014-01-30 05:11:01,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bf51394, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@400e2d8c}, log id: 1fcd19f2 >2014-01-30 05:11:01,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: b8eab5a >2014-01-30 05:11:01,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: b8eab5a >2014-01-30 05:11:01,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 259778c9 >2014-01-30 05:11:01,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 259778c9 >2014-01-30 05:11:06,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 57bd319c >2014-01-30 05:11:07,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 57bd319c >2014-01-30 05:11:07,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6bb5783a >2014-01-30 05:11:07,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@612dfceb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@143d0d56}, log id: 6bb5783a >2014-01-30 05:11:07,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 175362b6 >2014-01-30 05:11:08,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 175362b6 >2014-01-30 05:11:08,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 293d22c2 >2014-01-30 05:11:08,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 293d22c2 >2014-01-30 05:11:11,610 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-99) [63a33dd9] No up server in cluster >2014-01-30 05:11:11,610 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:11:11,613 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-99) [63a33dd9] No up server in cluster >2014-01-30 05:11:11,613 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:11:11,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 6d2ac34 >2014-01-30 05:11:12,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 6d2ac34 >2014-01-30 05:11:12,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 36a4fe7a >2014-01-30 05:11:12,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterTasksListVDSCommand, return: [], log id: 36a4fe7a >2014-01-30 05:11:13,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f026aed >2014-01-30 05:11:14,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4f026aed >2014-01-30 05:11:14,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a8d3a22 >2014-01-30 05:11:14,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9dc45632, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45003eb2}, log id: 2a8d3a22 >2014-01-30 05:11:14,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 296de721 >2014-01-30 05:11:14,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 296de721 >2014-01-30 05:11:14,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 124648a1 >2014-01-30 05:11:15,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 124648a1 >2014-01-30 05:11:20,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49e6e17a >2014-01-30 05:11:20,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 49e6e17a >2014-01-30 05:11:20,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5481088f >2014-01-30 05:11:20,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc9fe556, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17179811}, log id: 5481088f >2014-01-30 05:11:20,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 23f68491 >2014-01-30 05:11:21,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 23f68491 >2014-01-30 05:11:21,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 78d6da57 >2014-01-30 05:11:21,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78d6da57 >2014-01-30 05:11:26,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ae9cdbe >2014-01-30 05:11:27,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7ae9cdbe >2014-01-30 05:11:27,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7fc776bd >2014-01-30 05:11:27,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85e4d075, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e9e1340}, log id: 7fc776bd >2014-01-30 05:11:27,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ed9d847 >2014-01-30 05:11:27,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: ed9d847 >2014-01-30 05:11:27,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7b44b809 >2014-01-30 05:11:28,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b44b809 >2014-01-30 05:11:33,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d5c0f15 >2014-01-30 05:11:33,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1d5c0f15 >2014-01-30 05:11:33,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e23f3d6 >2014-01-30 05:11:33,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43cee762, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@acf26a5f}, log id: e23f3d6 >2014-01-30 05:11:34,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 692aefcc >2014-01-30 05:11:34,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 692aefcc >2014-01-30 05:11:34,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 43fac6bc >2014-01-30 05:11:34,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43fac6bc >2014-01-30 05:11:39,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 472be490 >2014-01-30 05:11:40,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 472be490 >2014-01-30 05:11:40,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 329744fe >2014-01-30 05:11:40,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@789cf50f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b979fec9}, log id: 329744fe >2014-01-30 05:11:40,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7c1e3ee0 >2014-01-30 05:11:41,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7c1e3ee0 >2014-01-30 05:11:41,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 519e80bc >2014-01-30 05:11:41,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 519e80bc >2014-01-30 05:11:46,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51e17389 >2014-01-30 05:11:46,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 51e17389 >2014-01-30 05:11:46,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6af049bb >2014-01-30 05:11:47,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a65ca5de, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@369ca347}, log id: 6af049bb >2014-01-30 05:11:47,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 29bf55a >2014-01-30 05:11:47,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 29bf55a >2014-01-30 05:11:47,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 32e67d34 >2014-01-30 05:11:47,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32e67d34 >2014-01-30 05:11:52,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 377bfbab >2014-01-30 05:11:53,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 377bfbab >2014-01-30 05:11:53,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65ad5bf7 >2014-01-30 05:11:53,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9d018d2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2588ba2a}, log id: 65ad5bf7 >2014-01-30 05:11:53,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5d74ee8f >2014-01-30 05:11:54,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5d74ee8f >2014-01-30 05:11:54,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 13dc73c2 >2014-01-30 05:11:54,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13dc73c2 >2014-01-30 05:11:59,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a320341 >2014-01-30 05:11:59,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2a320341 >2014-01-30 05:11:59,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41d8008b >2014-01-30 05:12:00,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a098f42, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@baebc}, log id: 41d8008b >2014-01-30 05:12:00,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2eb2a25f >2014-01-30 05:12:00,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2eb2a25f >2014-01-30 05:12:00,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: c92b336 >2014-01-30 05:12:01,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c92b336 >2014-01-30 05:12:06,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23f9abd8 >2014-01-30 05:12:06,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 23f9abd8 >2014-01-30 05:12:06,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a9c00b1 >2014-01-30 05:12:06,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da7ce7c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@763341d1}, log id: a9c00b1 >2014-01-30 05:12:06,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4f6fa3dc >2014-01-30 05:12:07,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4f6fa3dc >2014-01-30 05:12:07,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1d79202d >2014-01-30 05:12:07,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d79202d >2014-01-30 05:12:12,432 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) [23554188] No up server in cluster >2014-01-30 05:12:12,433 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) [23554188] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:12:12,435 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) [23554188] No up server in cluster >2014-01-30 05:12:12,435 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) [23554188] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:12:12,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a5749a2 >2014-01-30 05:12:12,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12e64bcf >2014-01-30 05:12:12,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 7a5749a2 >2014-01-30 05:12:12,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 1d203ef7 >2014-01-30 05:12:13,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 12e64bcf >2014-01-30 05:12:13,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21b11aaf >2014-01-30 05:12:13,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterTasksListVDSCommand, return: [], log id: 1d203ef7 >2014-01-30 05:12:13,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38ab467a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d061ddb}, log id: 21b11aaf >2014-01-30 05:12:13,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2a0bdbb >2014-01-30 05:12:13,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2a0bdbb >2014-01-30 05:12:13,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77d8975e >2014-01-30 05:12:14,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77d8975e >2014-01-30 05:12:19,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24f93b73 >2014-01-30 05:12:19,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 24f93b73 >2014-01-30 05:12:19,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1622645f >2014-01-30 05:12:19,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@305ca0f5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55eca5fb}, log id: 1622645f >2014-01-30 05:12:20,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 462c6079 >2014-01-30 05:12:20,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 462c6079 >2014-01-30 05:12:20,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 609eb50f >2014-01-30 05:12:20,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 609eb50f >2014-01-30 05:12:25,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31dbb360 >2014-01-30 05:12:26,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 31dbb360 >2014-01-30 05:12:26,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16f98721 >2014-01-30 05:12:26,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16b1b2a9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e404618e}, log id: 16f98721 >2014-01-30 05:12:26,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 322223f3 >2014-01-30 05:12:27,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 322223f3 >2014-01-30 05:12:27,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 485c96f0 >2014-01-30 05:12:27,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 485c96f0 >2014-01-30 05:12:32,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f42388f >2014-01-30 05:12:32,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1f42388f >2014-01-30 05:12:32,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30c34ce8 >2014-01-30 05:12:33,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f1ce308, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c982939c}, log id: 30c34ce8 >2014-01-30 05:12:33,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2c0f0fea >2014-01-30 05:12:33,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2c0f0fea >2014-01-30 05:12:33,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 16a96328 >2014-01-30 05:12:33,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16a96328 >2014-01-30 05:12:38,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 471b6ef0 >2014-01-30 05:12:39,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 471b6ef0 >2014-01-30 05:12:39,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 694bb146 >2014-01-30 05:12:39,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ff17853, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34b98210}, log id: 694bb146 >2014-01-30 05:12:39,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5aba1921 >2014-01-30 05:12:40,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5aba1921 >2014-01-30 05:12:40,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 213f4865 >2014-01-30 05:12:40,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 213f4865 >2014-01-30 05:12:45,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d77ec6f >2014-01-30 05:12:46,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5d77ec6f >2014-01-30 05:12:46,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 288d5e7b >2014-01-30 05:12:46,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e624a6ad, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce4c7982}, log id: 288d5e7b >2014-01-30 05:12:46,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 26c0c306 >2014-01-30 05:12:46,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 26c0c306 >2014-01-30 05:12:46,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 8fd11da >2014-01-30 05:12:47,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8fd11da >2014-01-30 05:12:52,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 70ac4f0c >2014-01-30 05:12:52,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 70ac4f0c >2014-01-30 05:12:52,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b9c6f22 >2014-01-30 05:12:52,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e178d3c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3886e735}, log id: 7b9c6f22 >2014-01-30 05:12:52,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d88f261 >2014-01-30 05:12:53,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: d88f261 >2014-01-30 05:12:53,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 177c5ab1 >2014-01-30 05:12:53,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 177c5ab1 >2014-01-30 05:12:58,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6993564e >2014-01-30 05:12:59,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6993564e >2014-01-30 05:12:59,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ddf4ddb >2014-01-30 05:12:59,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@affb66cb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2d504f3}, log id: 6ddf4ddb >2014-01-30 05:12:59,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 782d02a9 >2014-01-30 05:12:59,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 782d02a9 >2014-01-30 05:12:59,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3cda67c2 >2014-01-30 05:13:00,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cda67c2 >2014-01-30 05:13:05,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25e23002 >2014-01-30 05:13:05,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 25e23002 >2014-01-30 05:13:05,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1086007d >2014-01-30 05:13:05,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69c9a756, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aea68bbf}, log id: 1086007d >2014-01-30 05:13:05,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3dede1d3 >2014-01-30 05:13:06,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3dede1d3 >2014-01-30 05:13:06,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5222bb47 >2014-01-30 05:13:06,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5222bb47 >2014-01-30 05:13:11,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2dd7959c >2014-01-30 05:13:12,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2dd7959c >2014-01-30 05:13:12,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f0fb77a >2014-01-30 05:13:12,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24e82d1b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21c9e6eb}, log id: 7f0fb77a >2014-01-30 05:13:12,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a929f25 >2014-01-30 05:13:13,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7a929f25 >2014-01-30 05:13:13,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4673cf7f >2014-01-30 05:13:13,191 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] No up server in cluster >2014-01-30 05:13:13,191 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:13:13,194 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] No up server in cluster >2014-01-30 05:13:13,194 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:13:13,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76b767bc >2014-01-30 05:13:13,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4673cf7f >2014-01-30 05:13:13,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 76b767bc >2014-01-30 05:13:13,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 7b960dde >2014-01-30 05:13:14,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterTasksListVDSCommand, return: [], log id: 7b960dde >2014-01-30 05:13:18,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9db1097 >2014-01-30 05:13:18,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 9db1097 >2014-01-30 05:13:18,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f7582aa >2014-01-30 05:13:19,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e30ba80c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1bf6a2cb}, log id: 1f7582aa >2014-01-30 05:13:19,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 55f863ec >2014-01-30 05:13:19,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 55f863ec >2014-01-30 05:13:19,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 221c4603 >2014-01-30 05:13:19,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 221c4603 >2014-01-30 05:13:24,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38f7defa >2014-01-30 05:13:25,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 38f7defa >2014-01-30 05:13:25,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6afbca00 >2014-01-30 05:13:25,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ddb2e8e3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8db102d}, log id: 6afbca00 >2014-01-30 05:13:25,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 49246191 >2014-01-30 05:13:26,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 49246191 >2014-01-30 05:13:26,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 18ddf41b >2014-01-30 05:13:26,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18ddf41b >2014-01-30 05:13:31,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 75a06421 >2014-01-30 05:13:31,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 75a06421 >2014-01-30 05:13:31,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24ba663d >2014-01-30 05:13:32,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14c878c1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f851435}, log id: 24ba663d >2014-01-30 05:13:32,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 24898de1 >2014-01-30 05:13:32,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 24898de1 >2014-01-30 05:13:32,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1e2ef491 >2014-01-30 05:13:32,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e2ef491 >2014-01-30 05:13:37,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3236c228 >2014-01-30 05:13:38,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3236c228 >2014-01-30 05:13:38,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f19cb4e >2014-01-30 05:13:38,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ec4c322, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e3a92e6}, log id: 4f19cb4e >2014-01-30 05:13:38,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4f44dcbb >2014-01-30 05:13:39,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4f44dcbb >2014-01-30 05:13:39,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1fb1811 >2014-01-30 05:13:39,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fb1811 >2014-01-30 05:13:44,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38fb52f8 >2014-01-30 05:13:45,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 38fb52f8 >2014-01-30 05:13:45,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53c652d8 >2014-01-30 05:13:45,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db4bf1a2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a399f90c}, log id: 53c652d8 >2014-01-30 05:13:45,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1e1c2fb0 >2014-01-30 05:13:45,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1e1c2fb0 >2014-01-30 05:13:45,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b35127f >2014-01-30 05:13:46,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b35127f >2014-01-30 05:13:51,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d89067 >2014-01-30 05:13:51,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6d89067 >2014-01-30 05:13:51,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27b9067e >2014-01-30 05:13:51,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b247429b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@606acafd}, log id: 27b9067e >2014-01-30 05:13:51,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1e07914b >2014-01-30 05:13:52,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1e07914b >2014-01-30 05:13:52,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5b0de21f >2014-01-30 05:13:52,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b0de21f >2014-01-30 05:13:57,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e2cbc46 >2014-01-30 05:13:58,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3e2cbc46 >2014-01-30 05:13:58,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11d85a76 >2014-01-30 05:13:58,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c60efd2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ecfe03c4}, log id: 11d85a76 >2014-01-30 05:13:58,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1159cd51 >2014-01-30 05:13:58,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1159cd51 >2014-01-30 05:13:58,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5cb8e67e >2014-01-30 05:13:59,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cb8e67e >2014-01-30 05:14:04,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c8c8579 >2014-01-30 05:14:04,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: c8c8579 >2014-01-30 05:14:04,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a0499a7 >2014-01-30 05:14:04,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@544189c1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6667b345}, log id: 2a0499a7 >2014-01-30 05:14:04,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 13dff45c >2014-01-30 05:14:05,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 13dff45c >2014-01-30 05:14:05,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 32ebbabc >2014-01-30 05:14:05,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32ebbabc >2014-01-30 05:14:10,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2aa2fc1b >2014-01-30 05:14:11,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2aa2fc1b >2014-01-30 05:14:11,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 609263e4 >2014-01-30 05:14:11,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3b5809b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f894a951}, log id: 609263e4 >2014-01-30 05:14:11,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4ce0ca8c >2014-01-30 05:14:12,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4ce0ca8c >2014-01-30 05:14:12,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 41456229 >2014-01-30 05:14:12,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41456229 >2014-01-30 05:14:14,024 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-42) [cab85f1] No up server in cluster >2014-01-30 05:14:14,024 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-42) [cab85f1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:14:14,028 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-42) [cab85f1] No up server in cluster >2014-01-30 05:14:14,028 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-42) [cab85f1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:14:14,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 75c6d959 >2014-01-30 05:14:14,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 75c6d959 >2014-01-30 05:14:14,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 7066c1ac >2014-01-30 05:14:14,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterTasksListVDSCommand, return: [], log id: 7066c1ac >2014-01-30 05:14:17,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60e7f7d8 >2014-01-30 05:14:17,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 60e7f7d8 >2014-01-30 05:14:17,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a583738 >2014-01-30 05:14:18,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62374316, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bee5dea}, log id: 2a583738 >2014-01-30 05:14:18,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 51158d9e >2014-01-30 05:14:18,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 51158d9e >2014-01-30 05:14:18,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2518fef3 >2014-01-30 05:14:18,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2518fef3 >2014-01-30 05:14:23,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ebbc8ac >2014-01-30 05:14:24,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2ebbc8ac >2014-01-30 05:14:24,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12f1b497 >2014-01-30 05:14:24,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@460fcaf5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@632a37d6}, log id: 12f1b497 >2014-01-30 05:14:24,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4d61a00a >2014-01-30 05:14:25,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4d61a00a >2014-01-30 05:14:25,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 41a323c9 >2014-01-30 05:14:25,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41a323c9 >2014-01-30 05:14:30,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7735fa15 >2014-01-30 05:14:30,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7735fa15 >2014-01-30 05:14:30,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 70b24072 >2014-01-30 05:14:31,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7dd6156f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@680abb4}, log id: 70b24072 >2014-01-30 05:14:31,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6472f43e >2014-01-30 05:14:31,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6472f43e >2014-01-30 05:14:31,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 61988fe5 >2014-01-30 05:14:32,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61988fe5 >2014-01-30 05:14:37,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f799392 >2014-01-30 05:14:37,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5f799392 >2014-01-30 05:14:37,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56091d1e >2014-01-30 05:14:37,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9db3b26, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d703080b}, log id: 56091d1e >2014-01-30 05:14:37,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 465db2ca >2014-01-30 05:14:38,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 465db2ca >2014-01-30 05:14:38,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 660cceb5 >2014-01-30 05:14:38,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 660cceb5 >2014-01-30 05:14:43,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22557e9a >2014-01-30 05:14:44,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 22557e9a >2014-01-30 05:14:44,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 494b484 >2014-01-30 05:14:44,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2587370f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ba1c3fd}, log id: 494b484 >2014-01-30 05:14:44,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a93ac25 >2014-01-30 05:14:44,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7a93ac25 >2014-01-30 05:14:44,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7fe6f409 >2014-01-30 05:14:45,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fe6f409 >2014-01-30 05:14:50,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 690cf9a3 >2014-01-30 05:14:50,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 690cf9a3 >2014-01-30 05:14:50,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 161de15e >2014-01-30 05:14:50,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b454b561, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6326fe2}, log id: 161de15e >2014-01-30 05:14:50,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 41ea8f81 >2014-01-30 05:14:51,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 41ea8f81 >2014-01-30 05:14:51,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4f645203 >2014-01-30 05:14:51,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f645203 >2014-01-30 05:14:53,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4059ba6c >2014-01-30 05:14:53,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@5a559470, log id: 4059ba6c >2014-01-30 05:14:53,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 28847365 >2014-01-30 05:14:54,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@223f880b, log id: 28847365 >2014-01-30 05:14:56,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 28f9250a >2014-01-30 05:14:57,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 28f9250a >2014-01-30 05:14:57,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 113d14fd >2014-01-30 05:14:57,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1486a739, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a0e45cd}, log id: 113d14fd >2014-01-30 05:14:57,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2fb511a7 >2014-01-30 05:14:58,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2fb511a7 >2014-01-30 05:14:58,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6b9d5fc1 >2014-01-30 05:14:58,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b9d5fc1 >2014-01-30 05:15:03,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26b5e78c >2014-01-30 05:15:03,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 26b5e78c >2014-01-30 05:15:03,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 39657f9f >2014-01-30 05:15:04,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c1c3a85, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fda32523}, log id: 39657f9f >2014-01-30 05:15:04,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 11706b1a >2014-01-30 05:15:04,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 11706b1a >2014-01-30 05:15:04,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 43717b03 >2014-01-30 05:15:04,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43717b03 >2014-01-30 05:15:09,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53b912bf >2014-01-30 05:15:10,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 53b912bf >2014-01-30 05:15:10,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14b8c4b0 >2014-01-30 05:15:10,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@405d39d7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@641fdec1}, log id: 14b8c4b0 >2014-01-30 05:15:10,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ae49a8d >2014-01-30 05:15:11,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6ae49a8d >2014-01-30 05:15:11,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 58bc805b >2014-01-30 05:15:11,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58bc805b >2014-01-30 05:15:14,831 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-20) No up server in cluster >2014-01-30 05:15:14,831 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-20) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:15:14,835 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-20) No up server in cluster >2014-01-30 05:15:14,835 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-20) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:15:14,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 611145d >2014-01-30 05:15:15,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 611145d >2014-01-30 05:15:15,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 71b9af69 >2014-01-30 05:15:15,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterTasksListVDSCommand, return: [], log id: 71b9af69 >2014-01-30 05:15:16,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 359d229 >2014-01-30 05:15:16,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 359d229 >2014-01-30 05:15:16,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 497ec791 >2014-01-30 05:15:17,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e98fb2ca, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7934afa}, log id: 497ec791 >2014-01-30 05:15:17,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ef44991 >2014-01-30 05:15:17,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: ef44991 >2014-01-30 05:15:17,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6808ee9f >2014-01-30 05:15:17,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6808ee9f >2014-01-30 05:15:23,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42fbb03e >2014-01-30 05:15:23,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 42fbb03e >2014-01-30 05:15:23,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56820d0d >2014-01-30 05:15:23,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85ab661f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be5dc151}, log id: 56820d0d >2014-01-30 05:15:23,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 71c2be3 >2014-01-30 05:15:24,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 71c2be3 >2014-01-30 05:15:24,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 52ebb3b3 >2014-01-30 05:15:24,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52ebb3b3 >2014-01-30 05:15:29,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5277b21c >2014-01-30 05:15:30,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5277b21c >2014-01-30 05:15:30,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 557472ca >2014-01-30 05:15:30,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66213780, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83d422e}, log id: 557472ca >2014-01-30 05:15:30,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ea1253d >2014-01-30 05:15:30,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3ea1253d >2014-01-30 05:15:30,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2a16bf49 >2014-01-30 05:15:31,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a16bf49 >2014-01-30 05:15:36,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4649883b >2014-01-30 05:15:36,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4649883b >2014-01-30 05:15:36,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12d25dc6 >2014-01-30 05:15:36,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d8d5881, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2aa2c258}, log id: 12d25dc6 >2014-01-30 05:15:36,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1ac64c13 >2014-01-30 05:15:37,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1ac64c13 >2014-01-30 05:15:37,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 38f2d640 >2014-01-30 05:15:37,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38f2d640 >2014-01-30 05:15:42,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 380784a3 >2014-01-30 05:15:43,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 380784a3 >2014-01-30 05:15:43,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d122089 >2014-01-30 05:15:43,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44ebfbca, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bac798b9}, log id: 3d122089 >2014-01-30 05:15:43,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 55066ca9 >2014-01-30 05:15:43,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 55066ca9 >2014-01-30 05:15:43,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 275e3ef1 >2014-01-30 05:15:44,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 275e3ef1 >2014-01-30 05:15:49,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33a8aa17 >2014-01-30 05:15:49,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 33a8aa17 >2014-01-30 05:15:49,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d761007 >2014-01-30 05:15:50,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d303ee59, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4999313c}, log id: d761007 >2014-01-30 05:15:50,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1d8571d9 >2014-01-30 05:15:50,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1d8571d9 >2014-01-30 05:15:50,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 38cb355f >2014-01-30 05:15:50,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38cb355f >2014-01-30 05:15:55,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1cbc3dd9 >2014-01-30 05:15:56,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1cbc3dd9 >2014-01-30 05:15:56,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c86ba15 >2014-01-30 05:15:56,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac3b111b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a67e5ca}, log id: 7c86ba15 >2014-01-30 05:15:56,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 208c6748 >2014-01-30 05:15:57,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 208c6748 >2014-01-30 05:15:57,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 14009551 >2014-01-30 05:15:57,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14009551 >2014-01-30 05:16:02,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1aefd70d >2014-01-30 05:16:02,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1aefd70d >2014-01-30 05:16:02,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48d1c49a >2014-01-30 05:16:03,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7425e867, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41c93cd4}, log id: 48d1c49a >2014-01-30 05:16:03,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 52322f2a >2014-01-30 05:16:03,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 52322f2a >2014-01-30 05:16:03,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 166c8226 >2014-01-30 05:16:03,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 166c8226 >2014-01-30 05:16:08,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c4a4174 >2014-01-30 05:16:09,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4c4a4174 >2014-01-30 05:16:09,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: af5414e >2014-01-30 05:16:09,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3785f209, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7df3cea8}, log id: af5414e >2014-01-30 05:16:09,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7b1807c3 >2014-01-30 05:16:10,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7b1807c3 >2014-01-30 05:16:10,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7bacdba0 >2014-01-30 05:16:10,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7bacdba0 >2014-01-30 05:16:15,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 779fbe4a >2014-01-30 05:16:15,640 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) [213c04fd] No up server in cluster >2014-01-30 05:16:15,640 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) [213c04fd] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:16:15,643 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) [213c04fd] No up server in cluster >2014-01-30 05:16:15,643 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) [213c04fd] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:16:15,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 7dcf13a0 >2014-01-30 05:16:15,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 779fbe4a >2014-01-30 05:16:15,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53b51881 >2014-01-30 05:16:16,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 7dcf13a0 >2014-01-30 05:16:16,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 13c52a3b >2014-01-30 05:16:16,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa3277ad, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bdc2a77}, log id: 53b51881 >2014-01-30 05:16:16,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4fef8e0a >2014-01-30 05:16:16,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterTasksListVDSCommand, return: [], log id: 13c52a3b >2014-01-30 05:16:16,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4fef8e0a >2014-01-30 05:16:16,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 59ecc206 >2014-01-30 05:16:16,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59ecc206 >2014-01-30 05:16:21,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fff53d7 >2014-01-30 05:16:22,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3fff53d7 >2014-01-30 05:16:22,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9e23d9 >2014-01-30 05:16:22,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c103f7f3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40457a0c}, log id: 9e23d9 >2014-01-30 05:16:22,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 18ee53be >2014-01-30 05:16:23,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 18ee53be >2014-01-30 05:16:23,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4803ac32 >2014-01-30 05:16:23,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4803ac32 >2014-01-30 05:16:28,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9deacde >2014-01-30 05:16:28,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 9deacde >2014-01-30 05:16:28,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78298425 >2014-01-30 05:16:29,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45778d34, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25787594}, log id: 78298425 >2014-01-30 05:16:29,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d3d79a5 >2014-01-30 05:16:29,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7d3d79a5 >2014-01-30 05:16:29,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 10d9b8f3 >2014-01-30 05:16:30,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10d9b8f3 >2014-01-30 05:16:35,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f289a62 >2014-01-30 05:16:35,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6f289a62 >2014-01-30 05:16:35,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ff6d581 >2014-01-30 05:16:35,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10e63de7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b2ae152}, log id: 7ff6d581 >2014-01-30 05:16:35,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2423492d >2014-01-30 05:16:36,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2423492d >2014-01-30 05:16:36,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 40ee835f >2014-01-30 05:16:36,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40ee835f >2014-01-30 05:16:41,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: fa78a3d >2014-01-30 05:16:42,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: fa78a3d >2014-01-30 05:16:42,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b4fc6e7 >2014-01-30 05:16:42,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f41970a6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@165f370}, log id: 7b4fc6e7 >2014-01-30 05:16:42,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 47edff09 >2014-01-30 05:16:42,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 47edff09 >2014-01-30 05:16:42,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 71a36d0 >2014-01-30 05:16:43,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71a36d0 >2014-01-30 05:16:48,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65cd6abc >2014-01-30 05:16:48,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 65cd6abc >2014-01-30 05:16:48,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15ce7a8a >2014-01-30 05:16:49,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfabbdf9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92de072f}, log id: 15ce7a8a >2014-01-30 05:16:49,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3595d8ce >2014-01-30 05:16:49,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3595d8ce >2014-01-30 05:16:49,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3b2216e3 >2014-01-30 05:16:49,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b2216e3 >2014-01-30 05:16:54,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d5d639b >2014-01-30 05:16:55,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3d5d639b >2014-01-30 05:16:55,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e217b46 >2014-01-30 05:16:55,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@281b7964, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da49050c}, log id: 2e217b46 >2014-01-30 05:16:55,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7c08f6a7 >2014-01-30 05:16:56,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7c08f6a7 >2014-01-30 05:16:56,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e70b433 >2014-01-30 05:16:56,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e70b433 >2014-01-30 05:17:01,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68c8dfbd >2014-01-30 05:17:01,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 68c8dfbd >2014-01-30 05:17:01,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10a1cc7f >2014-01-30 05:17:02,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a82a9c3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@272245c6}, log id: 10a1cc7f >2014-01-30 05:17:02,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 471ee2b >2014-01-30 05:17:02,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 471ee2b >2014-01-30 05:17:02,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 485dda2b >2014-01-30 05:17:02,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 485dda2b >2014-01-30 05:17:07,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13fdd525 >2014-01-30 05:17:08,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 13fdd525 >2014-01-30 05:17:08,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a3ccccf >2014-01-30 05:17:08,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13ab2edf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8e0f7dc}, log id: a3ccccf >2014-01-30 05:17:08,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 750d1517 >2014-01-30 05:17:09,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 750d1517 >2014-01-30 05:17:09,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5b9dea83 >2014-01-30 05:17:09,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b9dea83 >2014-01-30 05:17:14,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 376999de >2014-01-30 05:17:14,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 376999de >2014-01-30 05:17:14,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ece26cc >2014-01-30 05:17:15,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b79b25ac, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41cfbc46}, log id: 5ece26cc >2014-01-30 05:17:15,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 19be8f07 >2014-01-30 05:17:15,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 19be8f07 >2014-01-30 05:17:15,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 269d9687 >2014-01-30 05:17:15,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 269d9687 >2014-01-30 05:17:16,423 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-43) [871abb5] No up server in cluster >2014-01-30 05:17:16,423 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-43) [871abb5] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:17:16,426 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-43) [871abb5] No up server in cluster >2014-01-30 05:17:16,426 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-43) [871abb5] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:17:16,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4dd0c133 >2014-01-30 05:17:16,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4dd0c133 >2014-01-30 05:17:16,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 45872d12 >2014-01-30 05:17:17,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterTasksListVDSCommand, return: [], log id: 45872d12 >2014-01-30 05:17:20,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f20696e >2014-01-30 05:17:21,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5f20696e >2014-01-30 05:17:21,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4bb1a876 >2014-01-30 05:17:21,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d6cb8f6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8638b09c}, log id: 4bb1a876 >2014-01-30 05:17:21,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5a1b5d74 >2014-01-30 05:17:22,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5a1b5d74 >2014-01-30 05:17:22,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 693e50bd >2014-01-30 05:17:22,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 693e50bd >2014-01-30 05:17:27,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d9d962d >2014-01-30 05:17:27,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4d9d962d >2014-01-30 05:17:28,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 141e3dfe >2014-01-30 05:17:28,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aede0c05, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fbe545d}, log id: 141e3dfe >2014-01-30 05:17:28,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3bed2b0a >2014-01-30 05:17:28,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3bed2b0a >2014-01-30 05:17:28,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2666478 >2014-01-30 05:17:29,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2666478 >2014-01-30 05:17:34,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50d8589f >2014-01-30 05:17:34,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 50d8589f >2014-01-30 05:17:34,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 786d2059 >2014-01-30 05:17:34,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@526a7075, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d894f55b}, log id: 786d2059 >2014-01-30 05:17:34,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 20d4ce2c >2014-01-30 05:17:35,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 20d4ce2c >2014-01-30 05:17:35,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4fd9130e >2014-01-30 05:17:35,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fd9130e >2014-01-30 05:17:40,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31082455 >2014-01-30 05:17:41,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 31082455 >2014-01-30 05:17:41,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6dff7f96 >2014-01-30 05:17:41,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc3208e1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f13a272e}, log id: 6dff7f96 >2014-01-30 05:17:41,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 60646d6d >2014-01-30 05:17:41,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 60646d6d >2014-01-30 05:17:41,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2ed77f6e >2014-01-30 05:17:42,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ed77f6e >2014-01-30 05:17:47,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7372c890 >2014-01-30 05:17:47,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7372c890 >2014-01-30 05:17:47,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18418086 >2014-01-30 05:17:47,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6721990, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a64f9963}, log id: 18418086 >2014-01-30 05:17:48,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7efde142 >2014-01-30 05:17:48,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7efde142 >2014-01-30 05:17:48,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 31811931 >2014-01-30 05:17:48,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31811931 >2014-01-30 05:17:53,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e18232c >2014-01-30 05:17:54,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3e18232c >2014-01-30 05:17:54,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e5c0632 >2014-01-30 05:17:54,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6287cd69, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34f48f37}, log id: 6e5c0632 >2014-01-30 05:17:54,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3e65248a >2014-01-30 05:17:55,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3e65248a >2014-01-30 05:17:55,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e67e4b9 >2014-01-30 05:17:55,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e67e4b9 >2014-01-30 05:18:00,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1da72fab >2014-01-30 05:18:00,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1da72fab >2014-01-30 05:18:00,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4daf1717 >2014-01-30 05:18:01,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e7ee0e6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32902fb9}, log id: 4daf1717 >2014-01-30 05:18:01,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77dc8964 >2014-01-30 05:18:01,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 77dc8964 >2014-01-30 05:18:01,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2a55cb1d >2014-01-30 05:18:01,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a55cb1d >2014-01-30 05:18:06,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20a5b92d >2014-01-30 05:18:07,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 20a5b92d >2014-01-30 05:18:07,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3733321f >2014-01-30 05:18:07,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1bafd741, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96e89437}, log id: 3733321f >2014-01-30 05:18:07,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6b537297 >2014-01-30 05:18:08,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6b537297 >2014-01-30 05:18:08,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 581043a4 >2014-01-30 05:18:08,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 581043a4 >2014-01-30 05:18:13,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1624d279 >2014-01-30 05:18:13,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1624d279 >2014-01-30 05:18:14,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41b7184b >2014-01-30 05:18:14,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff6292c8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5069efc}, log id: 41b7184b >2014-01-30 05:18:14,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 169494b7 >2014-01-30 05:18:14,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 169494b7 >2014-01-30 05:18:14,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 12fae478 >2014-01-30 05:18:15,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12fae478 >2014-01-30 05:18:17,259 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) [3472ce94] No up server in cluster >2014-01-30 05:18:17,260 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) [3472ce94] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:18:17,263 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) [3472ce94] No up server in cluster >2014-01-30 05:18:17,263 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) [3472ce94] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:18:17,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2cf14ea0 >2014-01-30 05:18:17,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 2cf14ea0 >2014-01-30 05:18:17,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 562e17d5 >2014-01-30 05:18:18,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterTasksListVDSCommand, return: [], log id: 562e17d5 >2014-01-30 05:18:20,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 608c0cf7 >2014-01-30 05:18:20,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 608c0cf7 >2014-01-30 05:18:20,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37d6fe97 >2014-01-30 05:18:20,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d807510, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75becb21}, log id: 37d6fe97 >2014-01-30 05:18:20,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7942812e >2014-01-30 05:18:21,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7942812e >2014-01-30 05:18:21,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 17d4c838 >2014-01-30 05:18:21,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17d4c838 >2014-01-30 05:18:26,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7366f64d >2014-01-30 05:18:27,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7366f64d >2014-01-30 05:18:27,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69257e55 >2014-01-30 05:18:27,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe126862, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db9daf02}, log id: 69257e55 >2014-01-30 05:18:27,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6d057f69 >2014-01-30 05:18:27,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6d057f69 >2014-01-30 05:18:27,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 367bc174 >2014-01-30 05:18:28,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 367bc174 >2014-01-30 05:18:33,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68c51ddc >2014-01-30 05:18:33,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 68c51ddc >2014-01-30 05:18:33,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a62047e >2014-01-30 05:18:34,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71ca9e4b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d542c91}, log id: 2a62047e >2014-01-30 05:18:34,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 412db2ae >2014-01-30 05:18:34,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 412db2ae >2014-01-30 05:18:34,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d087380 >2014-01-30 05:18:34,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d087380 >2014-01-30 05:18:39,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f642a9c >2014-01-30 05:18:40,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f642a9c >2014-01-30 05:18:40,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 257ebd6b >2014-01-30 05:18:40,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66bce438, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bcff3548}, log id: 257ebd6b >2014-01-30 05:18:40,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4126e521 >2014-01-30 05:18:41,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4126e521 >2014-01-30 05:18:41,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3e9cdad6 >2014-01-30 05:18:41,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e9cdad6 >2014-01-30 05:18:46,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43b78802 >2014-01-30 05:18:46,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43b78802 >2014-01-30 05:18:46,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b8fb368 >2014-01-30 05:18:47,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60cafb4e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45882e2c}, log id: b8fb368 >2014-01-30 05:18:47,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 39c161e0 >2014-01-30 05:18:47,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 39c161e0 >2014-01-30 05:18:47,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1f481ec5 >2014-01-30 05:18:47,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f481ec5 >2014-01-30 05:18:52,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5aca9dd6 >2014-01-30 05:18:53,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5aca9dd6 >2014-01-30 05:18:53,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4400d108 >2014-01-30 05:18:53,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39aadb52, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47ce9e94}, log id: 4400d108 >2014-01-30 05:18:53,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 517ede0 >2014-01-30 05:18:54,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 517ede0 >2014-01-30 05:18:54,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b0f30c6 >2014-01-30 05:18:54,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b0f30c6 >2014-01-30 05:18:59,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 597ac32c >2014-01-30 05:19:00,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 597ac32c >2014-01-30 05:19:00,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10467f24 >2014-01-30 05:19:00,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcb9b6bc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53bb0e3e}, log id: 10467f24 >2014-01-30 05:19:00,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 456e223a >2014-01-30 05:19:00,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 456e223a >2014-01-30 05:19:00,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 22b35f9 >2014-01-30 05:19:01,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22b35f9 >2014-01-30 05:19:06,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ab874e >2014-01-30 05:19:06,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2ab874e >2014-01-30 05:19:06,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c845952 >2014-01-30 05:19:06,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b2ef367, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2e79603}, log id: 5c845952 >2014-01-30 05:19:06,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6fe8f320 >2014-01-30 05:19:07,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6fe8f320 >2014-01-30 05:19:07,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 382241ab >2014-01-30 05:19:07,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 382241ab >2014-01-30 05:19:12,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7113a715 >2014-01-30 05:19:13,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7113a715 >2014-01-30 05:19:13,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ef22c96 >2014-01-30 05:19:13,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a13af80a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c81dd73}, log id: 1ef22c96 >2014-01-30 05:19:13,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4f60afab >2014-01-30 05:19:14,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4f60afab >2014-01-30 05:19:14,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6249593a >2014-01-30 05:19:14,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6249593a >2014-01-30 05:19:18,093 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-37) [2a3b7700] No up server in cluster >2014-01-30 05:19:18,093 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:19:18,096 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-37) [2a3b7700] No up server in cluster >2014-01-30 05:19:18,096 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:19:18,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 65035838 >2014-01-30 05:19:18,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 65035838 >2014-01-30 05:19:18,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1f448b8b >2014-01-30 05:19:18,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterTasksListVDSCommand, return: [], log id: 1f448b8b >2014-01-30 05:19:19,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8ce727a >2014-01-30 05:19:19,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 8ce727a >2014-01-30 05:19:19,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74eb9593 >2014-01-30 05:19:20,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@840fc061, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d33b082}, log id: 74eb9593 >2014-01-30 05:19:20,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4518e308 >2014-01-30 05:19:20,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4518e308 >2014-01-30 05:19:20,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4b2fd295 >2014-01-30 05:19:20,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b2fd295 >2014-01-30 05:19:25,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38721cb4 >2014-01-30 05:19:26,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 38721cb4 >2014-01-30 05:19:26,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e345f2c >2014-01-30 05:19:26,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1edf4b13, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64286871}, log id: 3e345f2c >2014-01-30 05:19:26,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4b10f289 >2014-01-30 05:19:27,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4b10f289 >2014-01-30 05:19:27,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2cd108ed >2014-01-30 05:19:27,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2cd108ed >2014-01-30 05:19:32,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12fd3be8 >2014-01-30 05:19:32,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 12fd3be8 >2014-01-30 05:19:32,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b95ade >2014-01-30 05:19:33,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53143a85, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f2f7a1c}, log id: 1b95ade >2014-01-30 05:19:33,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6cc246b9 >2014-01-30 05:19:33,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6cc246b9 >2014-01-30 05:19:33,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 58daf000 >2014-01-30 05:19:33,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58daf000 >2014-01-30 05:19:39,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 394c0ef6 >2014-01-30 05:19:39,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 394c0ef6 >2014-01-30 05:19:39,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ba31466 >2014-01-30 05:19:39,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95e703d2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9366572f}, log id: 3ba31466 >2014-01-30 05:19:39,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 70799000 >2014-01-30 05:19:40,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 70799000 >2014-01-30 05:19:40,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4fa8117 >2014-01-30 05:19:40,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fa8117 >2014-01-30 05:19:45,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 904e63a >2014-01-30 05:19:46,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 904e63a >2014-01-30 05:19:46,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fccd4bf >2014-01-30 05:19:46,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67b9c391, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ecfcace0}, log id: 3fccd4bf >2014-01-30 05:19:46,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2fbd6508 >2014-01-30 05:19:46,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2fbd6508 >2014-01-30 05:19:46,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7681ecbc >2014-01-30 05:19:47,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7681ecbc >2014-01-30 05:19:52,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 34086724 >2014-01-30 05:19:52,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 34086724 >2014-01-30 05:19:52,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d9a5e56 >2014-01-30 05:19:52,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35965f5f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6323b3b3}, log id: 7d9a5e56 >2014-01-30 05:19:52,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 47471c5c >2014-01-30 05:19:53,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 47471c5c >2014-01-30 05:19:53,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 250e658 >2014-01-30 05:19:53,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 250e658 >2014-01-30 05:19:54,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 6e81a6b6 >2014-01-30 05:19:54,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@24e76da8, log id: 6e81a6b6 >2014-01-30 05:19:54,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 55d04385 >2014-01-30 05:19:54,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@545d97ef, log id: 55d04385 >2014-01-30 05:19:58,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64d39565 >2014-01-30 05:19:59,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 64d39565 >2014-01-30 05:19:59,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f5e9167 >2014-01-30 05:19:59,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd951441, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d73664e}, log id: 5f5e9167 >2014-01-30 05:19:59,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3020ea34 >2014-01-30 05:19:59,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3020ea34 >2014-01-30 05:19:59,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2299ca0 >2014-01-30 05:20:00,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2299ca0 >2014-01-30 05:20:05,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 380c6bbd >2014-01-30 05:20:05,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 380c6bbd >2014-01-30 05:20:05,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22a8de5b >2014-01-30 05:20:05,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fedb3ff, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28f0ce56}, log id: 22a8de5b >2014-01-30 05:20:06,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2091a2a >2014-01-30 05:20:06,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2091a2a >2014-01-30 05:20:06,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: bf498b0 >2014-01-30 05:20:06,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: bf498b0 >2014-01-30 05:20:11,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e792988 >2014-01-30 05:20:12,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: e792988 >2014-01-30 05:20:12,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ded0931 >2014-01-30 05:20:12,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4521b7e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27746ea3}, log id: 3ded0931 >2014-01-30 05:20:12,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1f92878d >2014-01-30 05:20:13,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1f92878d >2014-01-30 05:20:13,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 354ddd95 >2014-01-30 05:20:13,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 354ddd95 >2014-01-30 05:20:18,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1dbfd17b >2014-01-30 05:20:18,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1dbfd17b >2014-01-30 05:20:18,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e02cb1e >2014-01-30 05:20:18,969 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-32) [18099453] No up server in cluster >2014-01-30 05:20:18,970 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-32) [18099453] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:20:18,973 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-32) [18099453] No up server in cluster >2014-01-30 05:20:18,973 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-32) [18099453] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:20:18,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4dbb42a >2014-01-30 05:20:19,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4e3f4e6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6dfeaa4a}, log id: e02cb1e >2014-01-30 05:20:19,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1a019460 >2014-01-30 05:20:19,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4dbb42a >2014-01-30 05:20:19,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 63947d3 >2014-01-30 05:20:19,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1a019460 >2014-01-30 05:20:19,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 625720d6 >2014-01-30 05:20:19,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterTasksListVDSCommand, return: [], log id: 63947d3 >2014-01-30 05:20:19,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 625720d6 >2014-01-30 05:20:24,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 709cb8fb >2014-01-30 05:20:25,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 709cb8fb >2014-01-30 05:20:25,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74dacf12 >2014-01-30 05:20:25,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a59f394e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b07ad6c}, log id: 74dacf12 >2014-01-30 05:20:25,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 219e3f58 >2014-01-30 05:20:26,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 219e3f58 >2014-01-30 05:20:26,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 27e2f035 >2014-01-30 05:20:26,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27e2f035 >2014-01-30 05:20:31,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19073822 >2014-01-30 05:20:31,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 19073822 >2014-01-30 05:20:31,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4be5fa35 >2014-01-30 05:20:32,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5a0b511, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b94af388}, log id: 4be5fa35 >2014-01-30 05:20:32,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d8e53a2 >2014-01-30 05:20:32,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7d8e53a2 >2014-01-30 05:20:32,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5211dd20 >2014-01-30 05:20:32,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5211dd20 >2014-01-30 05:20:37,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2100b71b >2014-01-30 05:20:38,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2100b71b >2014-01-30 05:20:38,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6930422d >2014-01-30 05:20:38,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@594eb171, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@faef9c2c}, log id: 6930422d >2014-01-30 05:20:38,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 39c0eee7 >2014-01-30 05:20:39,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 39c0eee7 >2014-01-30 05:20:39,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 677a34f1 >2014-01-30 05:20:39,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 677a34f1 >2014-01-30 05:20:44,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3137c3b9 >2014-01-30 05:20:45,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3137c3b9 >2014-01-30 05:20:45,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a0d2455 >2014-01-30 05:20:45,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3107c57, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3af77feb}, log id: 7a0d2455 >2014-01-30 05:20:45,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3dcfd3a3 >2014-01-30 05:20:45,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3dcfd3a3 >2014-01-30 05:20:45,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 330e8e9f >2014-01-30 05:20:46,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 330e8e9f >2014-01-30 05:20:51,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20bc68cd >2014-01-30 05:20:51,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 20bc68cd >2014-01-30 05:20:51,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2392dcc5 >2014-01-30 05:20:51,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6141b9dc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b77ce61}, log id: 2392dcc5 >2014-01-30 05:20:51,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6920b7e4 >2014-01-30 05:20:52,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6920b7e4 >2014-01-30 05:20:52,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 31ede69d >2014-01-30 05:20:52,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31ede69d >2014-01-30 05:20:57,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ee15ca6 >2014-01-30 05:20:58,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5ee15ca6 >2014-01-30 05:20:58,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 710e7d94 >2014-01-30 05:20:58,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6cdcf1d9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a008cbdb}, log id: 710e7d94 >2014-01-30 05:20:58,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 28e3fea2 >2014-01-30 05:20:58,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 28e3fea2 >2014-01-30 05:20:58,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 59915fa2 >2014-01-30 05:20:59,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59915fa2 >2014-01-30 05:21:04,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: fbcd069 >2014-01-30 05:21:04,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: fbcd069 >2014-01-30 05:21:04,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 558f6c67 >2014-01-30 05:21:04,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6c7f44e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d538afa}, log id: 558f6c67 >2014-01-30 05:21:05,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 32d17a82 >2014-01-30 05:21:05,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 32d17a82 >2014-01-30 05:21:05,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 12fe334c >2014-01-30 05:21:05,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12fe334c >2014-01-30 05:21:10,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d18d726 >2014-01-30 05:21:11,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4d18d726 >2014-01-30 05:21:11,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a70e71f >2014-01-30 05:21:11,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8541a4c3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4294e253}, log id: 4a70e71f >2014-01-30 05:21:11,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 158295ce >2014-01-30 05:21:12,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 158295ce >2014-01-30 05:21:12,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 50b13e44 >2014-01-30 05:21:12,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50b13e44 >2014-01-30 05:21:17,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54122638 >2014-01-30 05:21:17,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 54122638 >2014-01-30 05:21:17,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69c4ad7b >2014-01-30 05:21:18,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bbbb522, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77a93f05}, log id: 69c4ad7b >2014-01-30 05:21:18,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 78944624 >2014-01-30 05:21:18,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 78944624 >2014-01-30 05:21:18,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 501ba19 >2014-01-30 05:21:18,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 501ba19 >2014-01-30 05:21:19,745 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-14) [511b856] No up server in cluster >2014-01-30 05:21:19,745 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:21:19,748 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-14) [511b856] No up server in cluster >2014-01-30 05:21:19,748 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:21:19,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 43269af0 >2014-01-30 05:21:20,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 43269af0 >2014-01-30 05:21:20,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 50dbfc2b >2014-01-30 05:21:20,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterTasksListVDSCommand, return: [], log id: 50dbfc2b >2014-01-30 05:21:23,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5457982f >2014-01-30 05:21:24,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5457982f >2014-01-30 05:21:24,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2874e99c >2014-01-30 05:21:24,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1428b24d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87307d1}, log id: 2874e99c >2014-01-30 05:21:24,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65fb79c1 >2014-01-30 05:21:25,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 65fb79c1 >2014-01-30 05:21:25,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 14402f8e >2014-01-30 05:21:25,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14402f8e >2014-01-30 05:21:30,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68a78158 >2014-01-30 05:21:30,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 68a78158 >2014-01-30 05:21:30,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 348f467c >2014-01-30 05:21:31,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c4f5795, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b73dbf9c}, log id: 348f467c >2014-01-30 05:21:31,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 672ff1f4 >2014-01-30 05:21:31,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 672ff1f4 >2014-01-30 05:21:31,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1f095fc5 >2014-01-30 05:21:31,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f095fc5 >2014-01-30 05:21:36,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 522d4275 >2014-01-30 05:21:37,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 522d4275 >2014-01-30 05:21:37,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31e53ff8 >2014-01-30 05:21:37,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d419bdfb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec9d4bc7}, log id: 31e53ff8 >2014-01-30 05:21:37,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2e956d78 >2014-01-30 05:21:38,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2e956d78 >2014-01-30 05:21:38,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5ce295af >2014-01-30 05:21:38,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ce295af >2014-01-30 05:21:43,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6fdec05 >2014-01-30 05:21:43,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6fdec05 >2014-01-30 05:21:43,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50d6a79e >2014-01-30 05:21:44,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c3fffc6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fd8d810}, log id: 50d6a79e >2014-01-30 05:21:44,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7208ef54 >2014-01-30 05:21:44,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7208ef54 >2014-01-30 05:21:44,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1bfadf01 >2014-01-30 05:21:45,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1bfadf01 >2014-01-30 05:21:50,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6fdb4993 >2014-01-30 05:21:50,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6fdb4993 >2014-01-30 05:21:50,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d0c6667 >2014-01-30 05:21:50,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d462af25, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25592abe}, log id: 2d0c6667 >2014-01-30 05:21:50,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 30eab2bc >2014-01-30 05:21:51,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 30eab2bc >2014-01-30 05:21:51,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 59e0a588 >2014-01-30 05:21:51,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59e0a588 >2014-01-30 05:21:56,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 541c80dc >2014-01-30 05:21:57,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 541c80dc >2014-01-30 05:21:57,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: beb9c3b >2014-01-30 05:21:57,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83673c74, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11692ff1}, log id: beb9c3b >2014-01-30 05:21:57,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2c9baf2a >2014-01-30 05:21:57,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2c9baf2a >2014-01-30 05:21:57,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 671521f2 >2014-01-30 05:21:58,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 671521f2 >2014-01-30 05:22:03,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b7ef73b >2014-01-30 05:22:03,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b7ef73b >2014-01-30 05:22:03,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53e41a0d >2014-01-30 05:22:03,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da096579, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@630de8ec}, log id: 53e41a0d >2014-01-30 05:22:04,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1caae078 >2014-01-30 05:22:04,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1caae078 >2014-01-30 05:22:04,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a92fcad >2014-01-30 05:22:04,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a92fcad >2014-01-30 05:22:09,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f190c18 >2014-01-30 05:22:10,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7f190c18 >2014-01-30 05:22:10,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36da468b >2014-01-30 05:22:10,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cec446e2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@479d49d3}, log id: 36da468b >2014-01-30 05:22:10,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4fcbcf24 >2014-01-30 05:22:11,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4fcbcf24 >2014-01-30 05:22:11,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 44a7fd44 >2014-01-30 05:22:11,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44a7fd44 >2014-01-30 05:22:16,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b69b264 >2014-01-30 05:22:16,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6b69b264 >2014-01-30 05:22:16,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e2ad01d >2014-01-30 05:22:17,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26a50c4b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ad3b4af}, log id: 1e2ad01d >2014-01-30 05:22:17,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 20a20f5a >2014-01-30 05:22:17,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 20a20f5a >2014-01-30 05:22:17,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6c7b239c >2014-01-30 05:22:17,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c7b239c >2014-01-30 05:22:20,586 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-29) [520212b8] No up server in cluster >2014-01-30 05:22:20,587 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-29) [520212b8] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:22:20,589 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-29) [520212b8] No up server in cluster >2014-01-30 05:22:20,590 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-29) [520212b8] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:22:20,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 50abdcfd >2014-01-30 05:22:21,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 50abdcfd >2014-01-30 05:22:21,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 47171beb >2014-01-30 05:22:21,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterTasksListVDSCommand, return: [], log id: 47171beb >2014-01-30 05:22:22,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4cd08f2e >2014-01-30 05:22:23,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4cd08f2e >2014-01-30 05:22:23,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7720e9e5 >2014-01-30 05:22:23,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@633d33b9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a88bb892}, log id: 7720e9e5 >2014-01-30 05:22:23,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6edb211 >2014-01-30 05:22:24,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6edb211 >2014-01-30 05:22:24,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 714ffe51 >2014-01-30 05:22:24,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 714ffe51 >2014-01-30 05:22:29,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 57a9787b >2014-01-30 05:22:29,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 57a9787b >2014-01-30 05:22:29,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d44a725 >2014-01-30 05:22:30,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@446253f0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@454d2c85}, log id: 7d44a725 >2014-01-30 05:22:30,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: b64cf6a >2014-01-30 05:22:30,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: b64cf6a >2014-01-30 05:22:30,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 59c8401b >2014-01-30 05:22:30,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59c8401b >2014-01-30 05:22:36,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43662fe4 >2014-01-30 05:22:36,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43662fe4 >2014-01-30 05:22:36,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68e3578c >2014-01-30 05:22:36,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd3987b3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4094657}, log id: 68e3578c >2014-01-30 05:22:36,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 679ee402 >2014-01-30 05:22:37,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 679ee402 >2014-01-30 05:22:37,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4355de0c >2014-01-30 05:22:37,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4355de0c >2014-01-30 05:22:42,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12b1a8e2 >2014-01-30 05:22:43,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 12b1a8e2 >2014-01-30 05:22:43,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9875a9d >2014-01-30 05:22:43,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@993efce2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16043676}, log id: 9875a9d >2014-01-30 05:22:43,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 53a27363 >2014-01-30 05:22:43,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 53a27363 >2014-01-30 05:22:43,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5151f9c0 >2014-01-30 05:22:44,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5151f9c0 >2014-01-30 05:22:49,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 670fcffa >2014-01-30 05:22:49,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 670fcffa >2014-01-30 05:22:49,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65026875 >2014-01-30 05:22:49,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e1dc9f0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@983a20b3}, log id: 65026875 >2014-01-30 05:22:49,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 23b7ba2d >2014-01-30 05:22:50,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 23b7ba2d >2014-01-30 05:22:50,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6e624738 >2014-01-30 05:22:50,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e624738 >2014-01-30 05:22:55,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6812d5ba >2014-01-30 05:22:56,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6812d5ba >2014-01-30 05:22:56,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 28242a38 >2014-01-30 05:22:56,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78b8b85d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b78a3c5e}, log id: 28242a38 >2014-01-30 05:22:56,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1f8c02b9 >2014-01-30 05:22:57,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1f8c02b9 >2014-01-30 05:22:57,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2c5e5aab >2014-01-30 05:22:57,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c5e5aab >2014-01-30 05:23:02,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ab5394d >2014-01-30 05:23:02,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3ab5394d >2014-01-30 05:23:02,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a791d43 >2014-01-30 05:23:03,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b23a3a80, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5ff651a}, log id: 7a791d43 >2014-01-30 05:23:03,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3d835cf5 >2014-01-30 05:23:03,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3d835cf5 >2014-01-30 05:23:03,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5db86d68 >2014-01-30 05:23:03,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5db86d68 >2014-01-30 05:23:08,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65f44fe8 >2014-01-30 05:23:09,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 65f44fe8 >2014-01-30 05:23:09,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42696df0 >2014-01-30 05:23:09,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@962f86fc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@964de0b2}, log id: 42696df0 >2014-01-30 05:23:09,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 70b84c0a >2014-01-30 05:23:10,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 70b84c0a >2014-01-30 05:23:10,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4c73cc3f >2014-01-30 05:23:10,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c73cc3f >2014-01-30 05:23:15,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41a9dbef >2014-01-30 05:23:15,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 41a9dbef >2014-01-30 05:23:15,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26b8c3f0 >2014-01-30 05:23:16,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d9a43ee, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50fc4a27}, log id: 26b8c3f0 >2014-01-30 05:23:16,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 48ef52db >2014-01-30 05:23:16,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 48ef52db >2014-01-30 05:23:16,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2a98c182 >2014-01-30 05:23:16,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a98c182 >2014-01-30 05:23:21,411 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-71) [1ac2212e] No up server in cluster >2014-01-30 05:23:21,411 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-71) [1ac2212e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:23:21,414 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-71) [1ac2212e] No up server in cluster >2014-01-30 05:23:21,415 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-71) [1ac2212e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:23:21,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 727716b7 >2014-01-30 05:23:21,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 700cac1b >2014-01-30 05:23:22,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 727716b7 >2014-01-30 05:23:22,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 67886282 >2014-01-30 05:23:22,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 700cac1b >2014-01-30 05:23:22,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22eea0c2 >2014-01-30 05:23:22,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterTasksListVDSCommand, return: [], log id: 67886282 >2014-01-30 05:23:22,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6159f6ba, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88d27a28}, log id: 22eea0c2 >2014-01-30 05:23:22,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 50e63f3c >2014-01-30 05:23:23,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 50e63f3c >2014-01-30 05:23:23,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 796fb5c9 >2014-01-30 05:23:23,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 796fb5c9 >2014-01-30 05:23:28,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 73cd76fd >2014-01-30 05:23:28,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 73cd76fd >2014-01-30 05:23:28,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5fa5b08d >2014-01-30 05:23:29,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d85b15f1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2234485}, log id: 5fa5b08d >2014-01-30 05:23:29,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4aeb3e26 >2014-01-30 05:23:29,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4aeb3e26 >2014-01-30 05:23:29,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 58944f06 >2014-01-30 05:23:29,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58944f06 >2014-01-30 05:23:34,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 398959ef >2014-01-30 05:23:35,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 398959ef >2014-01-30 05:23:35,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e260f22 >2014-01-30 05:23:35,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ce216b7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1ac73a0}, log id: 4e260f22 >2014-01-30 05:23:35,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 44430940 >2014-01-30 05:23:36,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 44430940 >2014-01-30 05:23:36,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 71b43859 >2014-01-30 05:23:36,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71b43859 >2014-01-30 05:23:41,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 251a120e >2014-01-30 05:23:42,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 251a120e >2014-01-30 05:23:42,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78454210 >2014-01-30 05:23:42,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ed5100c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38e4fa5}, log id: 78454210 >2014-01-30 05:23:42,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 69c3de09 >2014-01-30 05:23:42,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 69c3de09 >2014-01-30 05:23:42,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 57e22a6e >2014-01-30 05:23:43,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57e22a6e >2014-01-30 05:23:48,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 205c0e16 >2014-01-30 05:23:48,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 205c0e16 >2014-01-30 05:23:48,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 406567d8 >2014-01-30 05:23:48,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19aaf9c0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@228e4066}, log id: 406567d8 >2014-01-30 05:23:48,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 400d08ea >2014-01-30 05:23:49,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 400d08ea >2014-01-30 05:23:49,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77b13e95 >2014-01-30 05:23:49,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77b13e95 >2014-01-30 05:23:54,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36ea6a5e >2014-01-30 05:23:55,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 36ea6a5e >2014-01-30 05:23:55,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79154760 >2014-01-30 05:23:55,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de12e1c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7eaccb92}, log id: 79154760 >2014-01-30 05:23:55,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1c39def9 >2014-01-30 05:23:56,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1c39def9 >2014-01-30 05:23:56,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6c0ea825 >2014-01-30 05:23:56,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c0ea825 >2014-01-30 05:24:01,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29ab25e1 >2014-01-30 05:24:01,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 29ab25e1 >2014-01-30 05:24:01,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6fab04d4 >2014-01-30 05:24:02,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@134d778, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf0399c8}, log id: 6fab04d4 >2014-01-30 05:24:02,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6f03efb8 >2014-01-30 05:24:02,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6f03efb8 >2014-01-30 05:24:02,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7591e3fb >2014-01-30 05:24:02,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7591e3fb >2014-01-30 05:24:07,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e7aece2 >2014-01-30 05:24:08,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6e7aece2 >2014-01-30 05:24:08,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d1239f4 >2014-01-30 05:24:08,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e20f34ab, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3d519c3}, log id: 1d1239f4 >2014-01-30 05:24:08,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 8df5bd9 >2014-01-30 05:24:09,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 8df5bd9 >2014-01-30 05:24:09,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 31bc7720 >2014-01-30 05:24:09,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31bc7720 >2014-01-30 05:24:14,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25f5216e >2014-01-30 05:24:14,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 25f5216e >2014-01-30 05:24:14,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71fb2dbd >2014-01-30 05:24:15,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89b4d4a1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99732f74}, log id: 71fb2dbd >2014-01-30 05:24:15,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 69e8c185 >2014-01-30 05:24:15,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 69e8c185 >2014-01-30 05:24:15,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4f0f1141 >2014-01-30 05:24:15,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f0f1141 >2014-01-30 05:24:20,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b7c841d >2014-01-30 05:24:21,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2b7c841d >2014-01-30 05:24:21,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4baed54 >2014-01-30 05:24:21,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c87c726, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfa1b327}, log id: 4baed54 >2014-01-30 05:24:21,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 113c0a58 >2014-01-30 05:24:22,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 113c0a58 >2014-01-30 05:24:22,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 37b46397 >2014-01-30 05:24:22,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37b46397 >2014-01-30 05:24:22,483 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-59) [499ce58b] No up server in cluster >2014-01-30 05:24:22,483 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-59) [499ce58b] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:24:22,486 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-59) [499ce58b] No up server in cluster >2014-01-30 05:24:22,486 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-59) [499ce58b] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:24:22,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 549361c7 >2014-01-30 05:24:23,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 549361c7 >2014-01-30 05:24:23,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 61194d13 >2014-01-30 05:24:23,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterTasksListVDSCommand, return: [], log id: 61194d13 >2014-01-30 05:24:27,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43ce4a9a >2014-01-30 05:24:27,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43ce4a9a >2014-01-30 05:24:27,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52db0a48 >2014-01-30 05:24:28,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa8d8196, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@798aec1d}, log id: 52db0a48 >2014-01-30 05:24:28,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6eba6d6 >2014-01-30 05:24:28,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6eba6d6 >2014-01-30 05:24:28,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 411d11d2 >2014-01-30 05:24:29,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 411d11d2 >2014-01-30 05:24:34,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 130d41a0 >2014-01-30 05:24:34,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 130d41a0 >2014-01-30 05:24:34,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78457ab6 >2014-01-30 05:24:34,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dce32fc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1784377}, log id: 78457ab6 >2014-01-30 05:24:34,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7be91940 >2014-01-30 05:24:35,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7be91940 >2014-01-30 05:24:35,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7feae6f4 >2014-01-30 05:24:35,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7feae6f4 >2014-01-30 05:24:40,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7743aace >2014-01-30 05:24:41,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7743aace >2014-01-30 05:24:41,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48d85f32 >2014-01-30 05:24:41,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfea485d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c178700e}, log id: 48d85f32 >2014-01-30 05:24:41,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5280c0a4 >2014-01-30 05:24:41,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5280c0a4 >2014-01-30 05:24:41,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 45e9ec29 >2014-01-30 05:24:42,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45e9ec29 >2014-01-30 05:24:47,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12da09e >2014-01-30 05:24:47,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 12da09e >2014-01-30 05:24:47,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77254227 >2014-01-30 05:24:47,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0bcf2a6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b649f6e1}, log id: 77254227 >2014-01-30 05:24:48,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 350398e1 >2014-01-30 05:24:48,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 350398e1 >2014-01-30 05:24:48,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77674754 >2014-01-30 05:24:48,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77674754 >2014-01-30 05:24:53,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79f03e2b >2014-01-30 05:24:54,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 79f03e2b >2014-01-30 05:24:54,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9539ae3 >2014-01-30 05:24:54,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77f5a606, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6e7fa0d}, log id: 9539ae3 >2014-01-30 05:24:54,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6f567c46 >2014-01-30 05:24:54,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 5d3b3efa >2014-01-30 05:24:55,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6f567c46 >2014-01-30 05:24:55,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5d1a64c9 >2014-01-30 05:24:55,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2c74404, log id: 5d3b3efa >2014-01-30 05:24:55,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 68426408 >2014-01-30 05:24:55,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d1a64c9 >2014-01-30 05:24:55,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@650c7922, log id: 68426408 >2014-01-30 05:25:00,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 768c80c >2014-01-30 05:25:00,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 768c80c >2014-01-30 05:25:00,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 231a7e98 >2014-01-30 05:25:01,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c92681f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b70b0f82}, log id: 231a7e98 >2014-01-30 05:25:01,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 61585dac >2014-01-30 05:25:01,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 61585dac >2014-01-30 05:25:01,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2c1ef8ce >2014-01-30 05:25:01,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c1ef8ce >2014-01-30 05:25:06,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6987e1fe >2014-01-30 05:25:07,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6987e1fe >2014-01-30 05:25:07,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 473a304c >2014-01-30 05:25:07,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82cc2c40, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34c56cd}, log id: 473a304c >2014-01-30 05:25:07,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 692f4ac4 >2014-01-30 05:25:08,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 692f4ac4 >2014-01-30 05:25:08,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4ba750ce >2014-01-30 05:25:08,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ba750ce >2014-01-30 05:25:13,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66a50fd2 >2014-01-30 05:25:13,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 66a50fd2 >2014-01-30 05:25:13,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42357444 >2014-01-30 05:25:14,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e89fa824, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@478c1a42}, log id: 42357444 >2014-01-30 05:25:14,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 105c69 >2014-01-30 05:25:14,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 105c69 >2014-01-30 05:25:14,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 501a000a >2014-01-30 05:25:14,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 501a000a >2014-01-30 05:25:20,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58783fab >2014-01-30 05:25:20,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 58783fab >2014-01-30 05:25:20,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6561f498 >2014-01-30 05:25:20,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac0d42f1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5992f562}, log id: 6561f498 >2014-01-30 05:25:20,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4fd32a94 >2014-01-30 05:25:21,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4fd32a94 >2014-01-30 05:25:21,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2c9ab957 >2014-01-30 05:25:21,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c9ab957 >2014-01-30 05:25:23,316 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-43) [871abb5] No up server in cluster >2014-01-30 05:25:23,316 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-43) [871abb5] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:25:23,319 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-43) [871abb5] No up server in cluster >2014-01-30 05:25:23,319 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-43) [871abb5] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:25:23,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 1d9d48af >2014-01-30 05:25:23,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 1d9d48af >2014-01-30 05:25:23,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 1a81ae5d >2014-01-30 05:25:24,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterTasksListVDSCommand, return: [], log id: 1a81ae5d >2014-01-30 05:25:26,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e08bf6c >2014-01-30 05:25:27,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4e08bf6c >2014-01-30 05:25:27,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ec417d1 >2014-01-30 05:25:27,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a2ec854, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a82493d}, log id: 6ec417d1 >2014-01-30 05:25:27,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1dd6117c >2014-01-30 05:25:27,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1dd6117c >2014-01-30 05:25:27,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 27aefa89 >2014-01-30 05:25:28,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27aefa89 >2014-01-30 05:25:33,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 45311f4a >2014-01-30 05:25:33,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 45311f4a >2014-01-30 05:25:33,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c07f799 >2014-01-30 05:25:33,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4f7d52c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df198e52}, log id: 5c07f799 >2014-01-30 05:25:34,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3359f81 >2014-01-30 05:25:34,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3359f81 >2014-01-30 05:25:34,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 754996cd >2014-01-30 05:25:34,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 754996cd >2014-01-30 05:25:39,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: eb73a3e >2014-01-30 05:25:40,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: eb73a3e >2014-01-30 05:25:40,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42ac0c81 >2014-01-30 05:25:40,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a322c7a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82d88fd1}, log id: 42ac0c81 >2014-01-30 05:25:40,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 625ce8f9 >2014-01-30 05:25:41,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 625ce8f9 >2014-01-30 05:25:41,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7deacd8a >2014-01-30 05:25:41,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7deacd8a >2014-01-30 05:25:46,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58f3354a >2014-01-30 05:25:46,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 58f3354a >2014-01-30 05:25:46,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6106dac4 >2014-01-30 05:25:47,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34ab97e3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f79a299d}, log id: 6106dac4 >2014-01-30 05:25:47,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 294e47e3 >2014-01-30 05:25:47,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 294e47e3 >2014-01-30 05:25:47,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1570c449 >2014-01-30 05:25:47,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1570c449 >2014-01-30 05:25:52,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f805c2f >2014-01-30 05:25:53,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7f805c2f >2014-01-30 05:25:53,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 94942de >2014-01-30 05:25:53,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b795d7d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc00b67b}, log id: 94942de >2014-01-30 05:25:53,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 61fe51a3 >2014-01-30 05:25:54,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 61fe51a3 >2014-01-30 05:25:54,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4ffb7cea >2014-01-30 05:25:54,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ffb7cea >2014-01-30 05:25:59,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65a227d9 >2014-01-30 05:25:59,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 65a227d9 >2014-01-30 05:25:59,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67d4445d >2014-01-30 05:26:00,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adfe0a79, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f7598f0}, log id: 67d4445d >2014-01-30 05:26:00,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 42a3c69c >2014-01-30 05:26:00,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 42a3c69c >2014-01-30 05:26:00,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 71b585b5 >2014-01-30 05:26:01,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71b585b5 >2014-01-30 05:26:06,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40f34233 >2014-01-30 05:26:06,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 40f34233 >2014-01-30 05:26:06,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59f3ed99 >2014-01-30 05:26:06,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@299adcd3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6664e68}, log id: 59f3ed99 >2014-01-30 05:26:06,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 45b34249 >2014-01-30 05:26:07,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 45b34249 >2014-01-30 05:26:07,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6500ee8b >2014-01-30 05:26:07,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6500ee8b >2014-01-30 05:26:12,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 75ffa64f >2014-01-30 05:26:13,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 75ffa64f >2014-01-30 05:26:13,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78ae5cf7 >2014-01-30 05:26:13,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d180e1fc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@918f9581}, log id: 78ae5cf7 >2014-01-30 05:26:13,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6c15974f >2014-01-30 05:26:13,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6c15974f >2014-01-30 05:26:13,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 706c3e59 >2014-01-30 05:26:14,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 706c3e59 >2014-01-30 05:26:19,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 73cf5362 >2014-01-30 05:26:19,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 73cf5362 >2014-01-30 05:26:19,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7802183c >2014-01-30 05:26:20,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2b9d39f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b36d}, log id: 7802183c >2014-01-30 05:26:20,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4910ffc8 >2014-01-30 05:26:20,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4910ffc8 >2014-01-30 05:26:20,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3c4611b9 >2014-01-30 05:26:20,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c4611b9 >2014-01-30 05:26:24,165 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] No up server in cluster >2014-01-30 05:26:24,165 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:26:24,168 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] No up server in cluster >2014-01-30 05:26:24,168 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:26:24,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 321a4cca >2014-01-30 05:26:24,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 321a4cca >2014-01-30 05:26:24,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 61a66ccf >2014-01-30 05:26:24,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterTasksListVDSCommand, return: [], log id: 61a66ccf >2014-01-30 05:26:25,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 692ef02a >2014-01-30 05:26:26,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 692ef02a >2014-01-30 05:26:26,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 553d79a5 >2014-01-30 05:26:26,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec13e5a1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1fd92bf5}, log id: 553d79a5 >2014-01-30 05:26:26,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 43193acc >2014-01-30 05:26:27,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 43193acc >2014-01-30 05:26:27,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2cc3a9f >2014-01-30 05:26:27,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2cc3a9f >2014-01-30 05:26:32,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a981a90 >2014-01-30 05:26:32,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6a981a90 >2014-01-30 05:26:32,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c7996c7 >2014-01-30 05:26:33,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53ce05ff, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7662f4bc}, log id: 6c7996c7 >2014-01-30 05:26:33,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 67aa8401 >2014-01-30 05:26:33,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 67aa8401 >2014-01-30 05:26:33,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: b0ec7c3 >2014-01-30 05:26:33,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b0ec7c3 >2014-01-30 05:26:38,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 714a0c82 >2014-01-30 05:26:39,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 714a0c82 >2014-01-30 05:26:39,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31bdcc10 >2014-01-30 05:26:39,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@770a83ae, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb304ac6}, log id: 31bdcc10 >2014-01-30 05:26:39,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 10ac7702 >2014-01-30 05:26:40,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 10ac7702 >2014-01-30 05:26:40,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 33900337 >2014-01-30 05:26:40,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33900337 >2014-01-30 05:26:45,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54c80a09 >2014-01-30 05:26:46,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 54c80a09 >2014-01-30 05:26:46,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 384f39fe >2014-01-30 05:26:46,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2319fe2f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64963b6}, log id: 384f39fe >2014-01-30 05:26:46,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5127754 >2014-01-30 05:26:46,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5127754 >2014-01-30 05:26:46,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7f079cbd >2014-01-30 05:26:47,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f079cbd >2014-01-30 05:26:52,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4149517a >2014-01-30 05:26:52,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4149517a >2014-01-30 05:26:52,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 324e862 >2014-01-30 05:26:52,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab1bc8ff, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67c9daad}, log id: 324e862 >2014-01-30 05:26:52,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6dfa834e >2014-01-30 05:26:53,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6dfa834e >2014-01-30 05:26:53,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 452a8933 >2014-01-30 05:26:53,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 452a8933 >2014-01-30 05:26:58,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35b9c7e >2014-01-30 05:26:59,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 35b9c7e >2014-01-30 05:26:59,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 534fbb60 >2014-01-30 05:26:59,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ca395ba, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fb8e656}, log id: 534fbb60 >2014-01-30 05:26:59,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a8ad740 >2014-01-30 05:26:59,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7a8ad740 >2014-01-30 05:26:59,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: e5bd84c >2014-01-30 05:27:00,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e5bd84c >2014-01-30 05:27:05,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c48ee5e >2014-01-30 05:27:05,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5c48ee5e >2014-01-30 05:27:05,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f986f7f >2014-01-30 05:27:05,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46154e3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbb1341}, log id: 6f986f7f >2014-01-30 05:27:05,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1dd4386e >2014-01-30 05:27:06,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1dd4386e >2014-01-30 05:27:06,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1cd3732b >2014-01-30 05:27:06,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cd3732b >2014-01-30 05:27:11,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c434625 >2014-01-30 05:27:12,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5c434625 >2014-01-30 05:27:12,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ee511e2 >2014-01-30 05:27:12,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c043e97, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2214038f}, log id: 7ee511e2 >2014-01-30 05:27:12,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5a03b39 >2014-01-30 05:27:12,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5a03b39 >2014-01-30 05:27:12,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7cdafd3e >2014-01-30 05:27:13,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cdafd3e >2014-01-30 05:27:18,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41fbbecf >2014-01-30 05:27:18,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 41fbbecf >2014-01-30 05:27:18,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e86f3f7 >2014-01-30 05:27:18,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4d2166e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31cbf583}, log id: 7e86f3f7 >2014-01-30 05:27:19,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 720bb33b >2014-01-30 05:27:19,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 720bb33b >2014-01-30 05:27:19,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 52ac9f51 >2014-01-30 05:27:19,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52ac9f51 >2014-01-30 05:27:24,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 70f02bbd >2014-01-30 05:27:25,006 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-42) [cab85f1] No up server in cluster >2014-01-30 05:27:25,006 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-42) [cab85f1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:27:25,009 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-42) [cab85f1] No up server in cluster >2014-01-30 05:27:25,010 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-42) [cab85f1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:27:25,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6dbb2059 >2014-01-30 05:27:25,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 70f02bbd >2014-01-30 05:27:25,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f3df7b3 >2014-01-30 05:27:25,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 6dbb2059 >2014-01-30 05:27:25,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7f429336 >2014-01-30 05:27:25,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0045bd1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73c908d4}, log id: f3df7b3 >2014-01-30 05:27:25,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 19197639 >2014-01-30 05:27:25,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterTasksListVDSCommand, return: [], log id: 7f429336 >2014-01-30 05:27:26,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 19197639 >2014-01-30 05:27:26,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3f9dca9b >2014-01-30 05:27:26,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f9dca9b >2014-01-30 05:27:31,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a417ab7 >2014-01-30 05:27:31,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7a417ab7 >2014-01-30 05:27:31,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35ec3641 >2014-01-30 05:27:32,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@beb47630, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d878f066}, log id: 35ec3641 >2014-01-30 05:27:32,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3aa667dd >2014-01-30 05:27:32,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3aa667dd >2014-01-30 05:27:32,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c1de238 >2014-01-30 05:27:32,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c1de238 >2014-01-30 05:27:37,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68fd92c6 >2014-01-30 05:27:38,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 68fd92c6 >2014-01-30 05:27:38,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d57c133 >2014-01-30 05:27:38,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9966b3b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2bf7d02}, log id: 2d57c133 >2014-01-30 05:27:38,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5b095ec6 >2014-01-30 05:27:39,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5b095ec6 >2014-01-30 05:27:39,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 66b6870c >2014-01-30 05:27:39,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66b6870c >2014-01-30 05:27:44,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a7e77fd >2014-01-30 05:27:44,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7a7e77fd >2014-01-30 05:27:44,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1aff382d >2014-01-30 05:27:45,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4edd8215, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a07f9185}, log id: 1aff382d >2014-01-30 05:27:45,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 46a828de >2014-01-30 05:27:45,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 46a828de >2014-01-30 05:27:45,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 15b48368 >2014-01-30 05:27:45,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15b48368 >2014-01-30 05:27:50,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d6f834a >2014-01-30 05:27:51,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2d6f834a >2014-01-30 05:27:51,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a735cf6 >2014-01-30 05:27:51,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49488975, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4355e81}, log id: 2a735cf6 >2014-01-30 05:27:51,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 52564d9a >2014-01-30 05:27:52,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 52564d9a >2014-01-30 05:27:52,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 36c97ccf >2014-01-30 05:27:52,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36c97ccf >2014-01-30 05:27:57,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79bcb57b >2014-01-30 05:27:58,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 79bcb57b >2014-01-30 05:27:58,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38167b8a >2014-01-30 05:27:58,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@753ca881, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18dcdbd6}, log id: 38167b8a >2014-01-30 05:27:58,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: e31ef8d >2014-01-30 05:27:58,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: e31ef8d >2014-01-30 05:27:58,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3bfb1abc >2014-01-30 05:27:59,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bfb1abc >2014-01-30 05:28:04,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ff1cdf5 >2014-01-30 05:28:04,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: ff1cdf5 >2014-01-30 05:28:04,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7891b8eb >2014-01-30 05:28:04,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1530d29f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a5144ea}, log id: 7891b8eb >2014-01-30 05:28:04,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 15dbd4f9 >2014-01-30 05:28:05,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 15dbd4f9 >2014-01-30 05:28:05,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 36eae147 >2014-01-30 05:28:05,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36eae147 >2014-01-30 05:28:10,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50e0c2eb >2014-01-30 05:28:11,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 50e0c2eb >2014-01-30 05:28:11,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6440d8a2 >2014-01-30 05:28:11,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3be5d0a4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63cb4447}, log id: 6440d8a2 >2014-01-30 05:28:11,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 88d9ca0 >2014-01-30 05:28:11,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 88d9ca0 >2014-01-30 05:28:11,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 32ecbe30 >2014-01-30 05:28:12,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32ecbe30 >2014-01-30 05:28:17,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a1ac3a2 >2014-01-30 05:28:17,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6a1ac3a2 >2014-01-30 05:28:17,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b9f13d8 >2014-01-30 05:28:18,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5b5d805, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e9ea773}, log id: 6b9f13d8 >2014-01-30 05:28:18,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 21a30a9f >2014-01-30 05:28:18,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 21a30a9f >2014-01-30 05:28:18,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ecec88f >2014-01-30 05:28:18,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ecec88f >2014-01-30 05:28:23,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6df1fe4 >2014-01-30 05:28:24,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6df1fe4 >2014-01-30 05:28:24,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10f3a33e >2014-01-30 05:28:24,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b59080a7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@541b258d}, log id: 10f3a33e >2014-01-30 05:28:24,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 59492b58 >2014-01-30 05:28:25,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 59492b58 >2014-01-30 05:28:25,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3e4c1174 >2014-01-30 05:28:25,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e4c1174 >2014-01-30 05:28:25,821 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-93) [24fadd7c] No up server in cluster >2014-01-30 05:28:25,821 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:28:25,824 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-93) [24fadd7c] No up server in cluster >2014-01-30 05:28:25,824 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:28:25,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 7c5fc498 >2014-01-30 05:28:26,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 7c5fc498 >2014-01-30 05:28:26,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: f0fd624 >2014-01-30 05:28:26,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterTasksListVDSCommand, return: [], log id: f0fd624 >2014-01-30 05:28:30,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c8dd4e7 >2014-01-30 05:28:30,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4c8dd4e7 >2014-01-30 05:28:30,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e7346f5 >2014-01-30 05:28:31,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99a43130, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a19424df}, log id: e7346f5 >2014-01-30 05:28:31,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 259d1522 >2014-01-30 05:28:31,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 259d1522 >2014-01-30 05:28:31,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2ca4282d >2014-01-30 05:28:31,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ca4282d >2014-01-30 05:28:36,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 735a6c8a >2014-01-30 05:28:37,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 735a6c8a >2014-01-30 05:28:37,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 310205b9 >2014-01-30 05:28:37,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8fe6669, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8cdfd4d6}, log id: 310205b9 >2014-01-30 05:28:37,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 48ea5454 >2014-01-30 05:28:38,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 48ea5454 >2014-01-30 05:28:38,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5f180fe9 >2014-01-30 05:28:38,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f180fe9 >2014-01-30 05:28:43,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44b232a4 >2014-01-30 05:28:44,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 44b232a4 >2014-01-30 05:28:44,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: cfe1000 >2014-01-30 05:28:44,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43cfbdd5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@915d7a7f}, log id: cfe1000 >2014-01-30 05:28:44,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6f4efdf8 >2014-01-30 05:28:44,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6f4efdf8 >2014-01-30 05:28:44,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1d7f96cf >2014-01-30 05:28:45,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d7f96cf >2014-01-30 05:28:50,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68695f45 >2014-01-30 05:28:50,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 68695f45 >2014-01-30 05:28:50,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2fad32b1 >2014-01-30 05:28:50,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@844f4a73, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6f3a19a}, log id: 2fad32b1 >2014-01-30 05:28:50,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 51aa792c >2014-01-30 05:28:51,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 51aa792c >2014-01-30 05:28:51,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1ab0440d >2014-01-30 05:28:51,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ab0440d >2014-01-30 05:28:56,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 102c9485 >2014-01-30 05:28:57,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 102c9485 >2014-01-30 05:28:57,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 760cae47 >2014-01-30 05:28:57,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cb80669, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eac2cc9}, log id: 760cae47 >2014-01-30 05:28:57,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7300d6d5 >2014-01-30 05:28:57,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7300d6d5 >2014-01-30 05:28:57,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 679bd05 >2014-01-30 05:28:58,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 679bd05 >2014-01-30 05:29:03,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1684ebf3 >2014-01-30 05:29:03,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1684ebf3 >2014-01-30 05:29:03,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3965a351 >2014-01-30 05:29:04,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9846cf85, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e337a29a}, log id: 3965a351 >2014-01-30 05:29:04,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 204c9e2d >2014-01-30 05:29:04,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 204c9e2d >2014-01-30 05:29:04,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3c7fccc3 >2014-01-30 05:29:04,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c7fccc3 >2014-01-30 05:29:09,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: be6bc5b >2014-01-30 05:29:10,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: be6bc5b >2014-01-30 05:29:10,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c57302c >2014-01-30 05:29:10,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@749eb0c7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae0fa8ab}, log id: 7c57302c >2014-01-30 05:29:10,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2f917ff6 >2014-01-30 05:29:11,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2f917ff6 >2014-01-30 05:29:11,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4dfcd33e >2014-01-30 05:29:11,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4dfcd33e >2014-01-30 05:29:16,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79cec230 >2014-01-30 05:29:16,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 79cec230 >2014-01-30 05:29:16,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18f1d1a9 >2014-01-30 05:29:17,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd54f0eb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e91ffe38}, log id: 18f1d1a9 >2014-01-30 05:29:17,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 521e7fbd >2014-01-30 05:29:17,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 521e7fbd >2014-01-30 05:29:17,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2d90ce5b >2014-01-30 05:29:17,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d90ce5b >2014-01-30 05:29:22,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7893113c >2014-01-30 05:29:23,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7893113c >2014-01-30 05:29:23,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5695b0fd >2014-01-30 05:29:23,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@354858ce, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82662312}, log id: 5695b0fd >2014-01-30 05:29:23,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 39fa5b23 >2014-01-30 05:29:24,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 39fa5b23 >2014-01-30 05:29:24,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5a14f9d3 >2014-01-30 05:29:24,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a14f9d3 >2014-01-30 05:29:26,658 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-14) [511b856] No up server in cluster >2014-01-30 05:29:26,658 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:29:26,661 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-14) [511b856] No up server in cluster >2014-01-30 05:29:26,661 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:29:26,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 15f349ad >2014-01-30 05:29:27,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 15f349ad >2014-01-30 05:29:27,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 6dfbbd30 >2014-01-30 05:29:27,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterTasksListVDSCommand, return: [], log id: 6dfbbd30 >2014-01-30 05:29:29,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 679d566d >2014-01-30 05:29:29,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 679d566d >2014-01-30 05:29:29,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3476ffc1 >2014-01-30 05:29:30,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3596d087, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9ffac35}, log id: 3476ffc1 >2014-01-30 05:29:30,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 613d2017 >2014-01-30 05:29:30,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 613d2017 >2014-01-30 05:29:30,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e827056 >2014-01-30 05:29:30,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e827056 >2014-01-30 05:29:35,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33addce >2014-01-30 05:29:36,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 33addce >2014-01-30 05:29:36,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7cc9dead >2014-01-30 05:29:36,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b46be76, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e516b4ce}, log id: 7cc9dead >2014-01-30 05:29:36,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7dcd7bc2 >2014-01-30 05:29:37,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7dcd7bc2 >2014-01-30 05:29:37,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 728bcb21 >2014-01-30 05:29:37,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 728bcb21 >2014-01-30 05:29:42,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 770e7e6d >2014-01-30 05:29:42,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 770e7e6d >2014-01-30 05:29:42,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27a50632 >2014-01-30 05:29:43,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e614503, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a91b071}, log id: 27a50632 >2014-01-30 05:29:43,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: f83a881 >2014-01-30 05:29:43,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: f83a881 >2014-01-30 05:29:43,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6f919c35 >2014-01-30 05:29:43,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f919c35 >2014-01-30 05:29:48,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 45183874 >2014-01-30 05:29:49,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 45183874 >2014-01-30 05:29:49,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c34124b >2014-01-30 05:29:49,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5caa32d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85dc2649}, log id: 3c34124b >2014-01-30 05:29:49,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 37a419ed >2014-01-30 05:29:50,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 37a419ed >2014-01-30 05:29:50,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6596fb0 >2014-01-30 05:29:50,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6596fb0 >2014-01-30 05:29:55,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7bcfe979 >2014-01-30 05:29:55,455 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-42) [cab85f1] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 05:29:55,494 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-42) [cab85f1] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 05:29:55,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7bcfe979 >2014-01-30 05:29:55,944 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-42) [cab85f1] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 05:29:55,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1339ac96 >2014-01-30 05:29:56,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2867ae51, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab7b509e}, log id: 1339ac96 >2014-01-30 05:29:56,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 302d36fd >2014-01-30 05:29:56,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 349142c5 >2014-01-30 05:29:56,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7189bd6a, log id: 302d36fd >2014-01-30 05:29:56,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 9f2b462 >2014-01-30 05:29:56,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 349142c5 >2014-01-30 05:29:56,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ee62c79 >2014-01-30 05:29:56,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3f92dfc4, log id: 9f2b462 >2014-01-30 05:29:56,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ee62c79 >2014-01-30 05:30:02,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24bb6580 >2014-01-30 05:30:02,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 24bb6580 >2014-01-30 05:30:02,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44e1bda0 >2014-01-30 05:30:02,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67b4788e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15aff2e2}, log id: 44e1bda0 >2014-01-30 05:30:02,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 779b5bfd >2014-01-30 05:30:03,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 779b5bfd >2014-01-30 05:30:03,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5f19befb >2014-01-30 05:30:03,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f19befb >2014-01-30 05:30:08,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a60b89f >2014-01-30 05:30:09,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2a60b89f >2014-01-30 05:30:09,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f8f4d55 >2014-01-30 05:30:09,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38030b0e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81726574}, log id: 5f8f4d55 >2014-01-30 05:30:09,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 33c4d1aa >2014-01-30 05:30:09,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 33c4d1aa >2014-01-30 05:30:09,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 34a929fd >2014-01-30 05:30:10,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34a929fd >2014-01-30 05:30:15,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d188350 >2014-01-30 05:30:15,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1d188350 >2014-01-30 05:30:15,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42a072ac >2014-01-30 05:30:15,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbb2b9df, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@736bf8e1}, log id: 42a072ac >2014-01-30 05:30:15,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 76361846 >2014-01-30 05:30:16,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 76361846 >2014-01-30 05:30:16,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 45c116f4 >2014-01-30 05:30:16,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45c116f4 >2014-01-30 05:30:21,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 547d1c79 >2014-01-30 05:30:22,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 547d1c79 >2014-01-30 05:30:22,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7476d652 >2014-01-30 05:30:22,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f1c3a82, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd4b81cc}, log id: 7476d652 >2014-01-30 05:30:22,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 20b4508e >2014-01-30 05:30:22,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 20b4508e >2014-01-30 05:30:22,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6e5450bb >2014-01-30 05:30:23,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e5450bb >2014-01-30 05:30:27,511 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] No up server in cluster >2014-01-30 05:30:27,511 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:30:27,515 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] No up server in cluster >2014-01-30 05:30:27,515 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:30:27,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 507355c2 >2014-01-30 05:30:28,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 507355c2 >2014-01-30 05:30:28,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 168de545 >2014-01-30 05:30:28,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66eef79c >2014-01-30 05:30:28,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterTasksListVDSCommand, return: [], log id: 168de545 >2014-01-30 05:30:28,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 66eef79c >2014-01-30 05:30:28,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48e76581 >2014-01-30 05:30:28,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41ad86d8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa463bf8}, log id: 48e76581 >2014-01-30 05:30:29,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 18869128 >2014-01-30 05:30:29,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 18869128 >2014-01-30 05:30:29,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 274ad138 >2014-01-30 05:30:29,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 274ad138 >2014-01-30 05:30:34,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f9482f8 >2014-01-30 05:30:35,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f9482f8 >2014-01-30 05:30:35,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a5357fe >2014-01-30 05:30:35,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7eda9ac0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7f7a3b1}, log id: 1a5357fe >2014-01-30 05:30:35,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1966de5f >2014-01-30 05:30:36,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1966de5f >2014-01-30 05:30:36,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5e111179 >2014-01-30 05:30:36,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e111179 >2014-01-30 05:30:41,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3bcc2d7f >2014-01-30 05:30:41,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3bcc2d7f >2014-01-30 05:30:41,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15e1920f >2014-01-30 05:30:42,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4ac66ea, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7e328f9}, log id: 15e1920f >2014-01-30 05:30:42,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 414eb04f >2014-01-30 05:30:42,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 414eb04f >2014-01-30 05:30:42,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7088a652 >2014-01-30 05:30:42,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7088a652 >2014-01-30 05:30:47,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: be12817 >2014-01-30 05:30:48,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: be12817 >2014-01-30 05:30:48,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74787d95 >2014-01-30 05:30:48,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2036b7fb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d43771b1}, log id: 74787d95 >2014-01-30 05:30:48,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a5ebc50 >2014-01-30 05:30:49,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7a5ebc50 >2014-01-30 05:30:49,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 53e23959 >2014-01-30 05:30:49,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53e23959 >2014-01-30 05:30:54,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d062934 >2014-01-30 05:30:54,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7d062934 >2014-01-30 05:30:54,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21e905b7 >2014-01-30 05:30:55,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc953f07, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c48a80a}, log id: 21e905b7 >2014-01-30 05:30:55,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 762540f9 >2014-01-30 05:30:55,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 762540f9 >2014-01-30 05:30:55,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 32752bce >2014-01-30 05:30:56,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32752bce >2014-01-30 05:31:01,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7780e14c >2014-01-30 05:31:01,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7780e14c >2014-01-30 05:31:01,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 624ede06 >2014-01-30 05:31:01,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2231a7a0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44d0444d}, log id: 624ede06 >2014-01-30 05:31:01,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 16c81f9c >2014-01-30 05:31:02,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 16c81f9c >2014-01-30 05:31:02,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5bd4f760 >2014-01-30 05:31:02,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5bd4f760 >2014-01-30 05:31:07,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6cd2177c >2014-01-30 05:31:08,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6cd2177c >2014-01-30 05:31:08,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d30eee4 >2014-01-30 05:31:08,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec0bd8a8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ef8f36}, log id: 5d30eee4 >2014-01-30 05:31:08,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 48227b6e >2014-01-30 05:31:08,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 48227b6e >2014-01-30 05:31:08,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 34315571 >2014-01-30 05:31:09,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34315571 >2014-01-30 05:31:14,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32fa4a7d >2014-01-30 05:31:14,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 32fa4a7d >2014-01-30 05:31:14,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 61854187 >2014-01-30 05:31:14,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5ad8f6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@346b354e}, log id: 61854187 >2014-01-30 05:31:14,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 38a5207 >2014-01-30 05:31:15,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 38a5207 >2014-01-30 05:31:15,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 63d20a0c >2014-01-30 05:31:15,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63d20a0c >2014-01-30 05:31:20,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ff7b5ad >2014-01-30 05:31:21,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: ff7b5ad >2014-01-30 05:31:21,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19516e9b >2014-01-30 05:31:21,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe9cf660, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e88d7a2}, log id: 19516e9b >2014-01-30 05:31:21,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65b5e391 >2014-01-30 05:31:22,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 65b5e391 >2014-01-30 05:31:22,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5e884c12 >2014-01-30 05:31:22,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e884c12 >2014-01-30 05:31:27,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e16bdb9 >2014-01-30 05:31:27,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e16bdb9 >2014-01-30 05:31:27,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76e12fb8 >2014-01-30 05:31:28,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7078e202, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c316ce23}, log id: 76e12fb8 >2014-01-30 05:31:28,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 182d41f9 >2014-01-30 05:31:28,332 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2014-01-30 05:31:28,332 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:31:28,335 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2014-01-30 05:31:28,335 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:31:28,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 79ed3e83 >2014-01-30 05:31:28,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 182d41f9 >2014-01-30 05:31:28,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4438a596 >2014-01-30 05:31:28,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4438a596 >2014-01-30 05:31:28,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 79ed3e83 >2014-01-30 05:31:28,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 52928486 >2014-01-30 05:31:29,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [], log id: 52928486 >2014-01-30 05:31:33,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 174358db >2014-01-30 05:31:34,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 174358db >2014-01-30 05:31:34,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 57abeb48 >2014-01-30 05:31:34,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2f3e8ae, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7cee035d}, log id: 57abeb48 >2014-01-30 05:31:34,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: a8af2d9 >2014-01-30 05:31:35,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: a8af2d9 >2014-01-30 05:31:35,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1e38ee0a >2014-01-30 05:31:35,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e38ee0a >2014-01-30 05:31:40,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b76761d >2014-01-30 05:31:40,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2b76761d >2014-01-30 05:31:40,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c1f476e >2014-01-30 05:31:41,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd7e3f5b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@999f3811}, log id: 6c1f476e >2014-01-30 05:31:41,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 642ee4ac >2014-01-30 05:31:41,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 642ee4ac >2014-01-30 05:31:41,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a2f7f2c >2014-01-30 05:31:41,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a2f7f2c >2014-01-30 05:31:46,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 62f2ce42 >2014-01-30 05:31:47,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 62f2ce42 >2014-01-30 05:31:47,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 28813eb8 >2014-01-30 05:31:47,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b224bdf2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fa45bbb}, log id: 28813eb8 >2014-01-30 05:31:47,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 67ca67e8 >2014-01-30 05:31:48,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 67ca67e8 >2014-01-30 05:31:48,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 23863906 >2014-01-30 05:31:48,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23863906 >2014-01-30 05:31:53,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7101db20 >2014-01-30 05:31:54,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7101db20 >2014-01-30 05:31:54,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5213cc59 >2014-01-30 05:31:54,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8acd8a18, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@751fd934}, log id: 5213cc59 >2014-01-30 05:31:54,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 263cbe89 >2014-01-30 05:31:54,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 263cbe89 >2014-01-30 05:31:54,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6f130140 >2014-01-30 05:31:55,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f130140 >2014-01-30 05:32:00,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c6281c6 >2014-01-30 05:32:00,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c6281c6 >2014-01-30 05:32:00,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 302adc6a >2014-01-30 05:32:00,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b5f9be0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0aea1eb}, log id: 302adc6a >2014-01-30 05:32:00,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 41d62de0 >2014-01-30 05:32:01,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 41d62de0 >2014-01-30 05:32:01,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 155009cc >2014-01-30 05:32:01,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 155009cc >2014-01-30 05:32:06,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 39644373 >2014-01-30 05:32:07,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 39644373 >2014-01-30 05:32:07,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 710e2de4 >2014-01-30 05:32:07,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb83960b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcbd5dca}, log id: 710e2de4 >2014-01-30 05:32:07,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2f39eda0 >2014-01-30 05:32:07,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2f39eda0 >2014-01-30 05:32:07,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 20c18337 >2014-01-30 05:32:08,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20c18337 >2014-01-30 05:32:13,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d3a55bb >2014-01-30 05:32:13,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5d3a55bb >2014-01-30 05:32:13,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 332a9ff5 >2014-01-30 05:32:13,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0bf2f4d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64e26e6d}, log id: 332a9ff5 >2014-01-30 05:32:13,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7e659590 >2014-01-30 05:32:14,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7e659590 >2014-01-30 05:32:14,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 56213c5e >2014-01-30 05:32:14,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56213c5e >2014-01-30 05:32:19,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e22f873 >2014-01-30 05:32:20,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1e22f873 >2014-01-30 05:32:20,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40eeefa2 >2014-01-30 05:32:20,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a84f5fe, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@520dcac3}, log id: 40eeefa2 >2014-01-30 05:32:20,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5675d5f3 >2014-01-30 05:32:21,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5675d5f3 >2014-01-30 05:32:21,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 216de0fc >2014-01-30 05:32:21,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 216de0fc >2014-01-30 05:32:26,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a4cbfdb >2014-01-30 05:32:26,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7a4cbfdb >2014-01-30 05:32:26,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 253e433c >2014-01-30 05:32:27,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8137284d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b92d40a2}, log id: 253e433c >2014-01-30 05:32:27,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 63e9e2db >2014-01-30 05:32:27,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 63e9e2db >2014-01-30 05:32:27,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 33941fcd >2014-01-30 05:32:27,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33941fcd >2014-01-30 05:32:29,125 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) [1f17c565] No up server in cluster >2014-01-30 05:32:29,125 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) [1f17c565] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:32:29,128 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) [1f17c565] No up server in cluster >2014-01-30 05:32:29,128 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) [1f17c565] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:32:29,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 17920813 >2014-01-30 05:32:29,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 17920813 >2014-01-30 05:32:29,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 2f2b5892 >2014-01-30 05:32:29,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterTasksListVDSCommand, return: [], log id: 2f2b5892 >2014-01-30 05:32:32,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5aa298eb >2014-01-30 05:32:33,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5aa298eb >2014-01-30 05:32:33,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 223709b4 >2014-01-30 05:32:33,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c700c131, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3aeb998}, log id: 223709b4 >2014-01-30 05:32:33,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 56ffe69 >2014-01-30 05:32:34,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 56ffe69 >2014-01-30 05:32:34,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d426a20 >2014-01-30 05:32:34,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d426a20 >2014-01-30 05:32:39,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41954074 >2014-01-30 05:32:39,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 41954074 >2014-01-30 05:32:39,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27769561 >2014-01-30 05:32:40,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25d40fab, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53e5d4be}, log id: 27769561 >2014-01-30 05:32:40,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2050bfc7 >2014-01-30 05:32:40,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2050bfc7 >2014-01-30 05:32:40,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e248578 >2014-01-30 05:32:41,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e248578 >2014-01-30 05:32:46,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a8d75d5 >2014-01-30 05:32:46,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2a8d75d5 >2014-01-30 05:32:46,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f40cc57 >2014-01-30 05:32:46,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53294749, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adeea659}, log id: 4f40cc57 >2014-01-30 05:32:46,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5883e68f >2014-01-30 05:32:47,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5883e68f >2014-01-30 05:32:47,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2e9ea155 >2014-01-30 05:32:47,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e9ea155 >2014-01-30 05:32:52,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f7f26a5 >2014-01-30 05:32:53,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f7f26a5 >2014-01-30 05:32:53,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 47e54ee8 >2014-01-30 05:32:53,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62f88793, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cfa2375}, log id: 47e54ee8 >2014-01-30 05:32:53,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d7cde1c >2014-01-30 05:32:53,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: d7cde1c >2014-01-30 05:32:53,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1f99d9dc >2014-01-30 05:32:54,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f99d9dc >2014-01-30 05:32:59,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10b5c297 >2014-01-30 05:32:59,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 10b5c297 >2014-01-30 05:32:59,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ffc570d >2014-01-30 05:32:59,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db757238, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d13f35ea}, log id: ffc570d >2014-01-30 05:32:59,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 101147ba >2014-01-30 05:33:00,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 101147ba >2014-01-30 05:33:00,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: a3a3997 >2014-01-30 05:33:00,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a3a3997 >2014-01-30 05:33:05,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d401078 >2014-01-30 05:33:06,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: d401078 >2014-01-30 05:33:06,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2344b5f2 >2014-01-30 05:33:06,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6a2c1fb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@969ab9d6}, log id: 2344b5f2 >2014-01-30 05:33:06,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1228a3e1 >2014-01-30 05:33:07,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1228a3e1 >2014-01-30 05:33:07,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ce5dbb6 >2014-01-30 05:33:07,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ce5dbb6 >2014-01-30 05:33:12,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: eb38a82 >2014-01-30 05:33:12,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: eb38a82 >2014-01-30 05:33:12,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e70e473 >2014-01-30 05:33:13,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2bc8bb64, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8dc57dc}, log id: 1e70e473 >2014-01-30 05:33:13,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 689fab20 >2014-01-30 05:33:13,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 689fab20 >2014-01-30 05:33:13,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e0a5fe4 >2014-01-30 05:33:13,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e0a5fe4 >2014-01-30 05:33:18,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ccf8af1 >2014-01-30 05:33:19,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5ccf8af1 >2014-01-30 05:33:19,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b8fbf0a >2014-01-30 05:33:19,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3548bbc3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1581ef13}, log id: 5b8fbf0a >2014-01-30 05:33:19,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1c62aabc >2014-01-30 05:33:20,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1c62aabc >2014-01-30 05:33:20,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3620fd1f >2014-01-30 05:33:20,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3620fd1f >2014-01-30 05:33:25,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7bb2f5b0 >2014-01-30 05:33:25,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7bb2f5b0 >2014-01-30 05:33:25,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e64bb1f >2014-01-30 05:33:26,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb5d3322, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b92085d}, log id: e64bb1f >2014-01-30 05:33:26,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c48423d >2014-01-30 05:33:26,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5c48423d >2014-01-30 05:33:26,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 31a4d9d >2014-01-30 05:33:26,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31a4d9d >2014-01-30 05:33:29,939 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) [23554188] No up server in cluster >2014-01-30 05:33:29,939 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) [23554188] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:33:29,943 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) [23554188] No up server in cluster >2014-01-30 05:33:29,943 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) [23554188] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:33:29,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 508d3c2e >2014-01-30 05:33:30,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 508d3c2e >2014-01-30 05:33:30,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 25f97be6 >2014-01-30 05:33:30,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterTasksListVDSCommand, return: [], log id: 25f97be6 >2014-01-30 05:33:31,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 610c3939 >2014-01-30 05:33:32,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 610c3939 >2014-01-30 05:33:32,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ab534f0 >2014-01-30 05:33:32,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44971c49, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b58d29e}, log id: 5ab534f0 >2014-01-30 05:33:32,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 125d6bdd >2014-01-30 05:33:33,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 125d6bdd >2014-01-30 05:33:33,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5d383eb8 >2014-01-30 05:33:33,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d383eb8 >2014-01-30 05:33:38,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f29a9f6 >2014-01-30 05:33:38,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7f29a9f6 >2014-01-30 05:33:38,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 776babd5 >2014-01-30 05:33:39,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2305399f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a762d23f}, log id: 776babd5 >2014-01-30 05:33:39,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 740b54bb >2014-01-30 05:33:39,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 740b54bb >2014-01-30 05:33:39,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 728f3d03 >2014-01-30 05:33:39,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 728f3d03 >2014-01-30 05:33:44,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9378bd8 >2014-01-30 05:33:45,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 9378bd8 >2014-01-30 05:33:45,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1def2856 >2014-01-30 05:33:45,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bee91f23, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab4a90f}, log id: 1def2856 >2014-01-30 05:33:45,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 35d944bf >2014-01-30 05:33:46,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 35d944bf >2014-01-30 05:33:46,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3d3c3697 >2014-01-30 05:33:46,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d3c3697 >2014-01-30 05:33:51,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c2acd97 >2014-01-30 05:33:52,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c2acd97 >2014-01-30 05:33:52,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 124148c2 >2014-01-30 05:33:52,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11ecc4c5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7feaf07}, log id: 124148c2 >2014-01-30 05:33:52,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d5e37d8 >2014-01-30 05:33:52,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: d5e37d8 >2014-01-30 05:33:52,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 29329f76 >2014-01-30 05:33:53,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29329f76 >2014-01-30 05:33:58,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9ab8d49 >2014-01-30 05:33:58,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 9ab8d49 >2014-01-30 05:33:58,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d832b20 >2014-01-30 05:33:58,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a0f952c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2a3c918}, log id: 4d832b20 >2014-01-30 05:33:58,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2ac11e53 >2014-01-30 05:33:59,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2ac11e53 >2014-01-30 05:33:59,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 62c9420d >2014-01-30 05:33:59,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62c9420d >2014-01-30 05:34:04,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 299b79cf >2014-01-30 05:34:05,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 299b79cf >2014-01-30 05:34:05,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41298948 >2014-01-30 05:34:05,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3849d28b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffc50a62}, log id: 41298948 >2014-01-30 05:34:05,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4962c1ae >2014-01-30 05:34:05,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4962c1ae >2014-01-30 05:34:05,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3d31173 >2014-01-30 05:34:06,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d31173 >2014-01-30 05:34:11,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3040d20e >2014-01-30 05:34:11,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3040d20e >2014-01-30 05:34:11,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 551d1b1b >2014-01-30 05:34:12,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6696cff7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6482d16e}, log id: 551d1b1b >2014-01-30 05:34:12,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2079a5c0 >2014-01-30 05:34:12,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2079a5c0 >2014-01-30 05:34:12,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 38888fcc >2014-01-30 05:34:12,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38888fcc >2014-01-30 05:34:17,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64b4d8a5 >2014-01-30 05:34:18,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 64b4d8a5 >2014-01-30 05:34:18,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c4218a2 >2014-01-30 05:34:18,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b946095, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@287bdb20}, log id: 5c4218a2 >2014-01-30 05:34:18,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7f093873 >2014-01-30 05:34:19,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7f093873 >2014-01-30 05:34:19,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 42b30d7c >2014-01-30 05:34:19,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42b30d7c >2014-01-30 05:34:24,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22831e29 >2014-01-30 05:34:24,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 22831e29 >2014-01-30 05:34:24,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 948d367 >2014-01-30 05:34:25,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad6e3c98, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a2758f0}, log id: 948d367 >2014-01-30 05:34:25,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3c44c6dd >2014-01-30 05:34:25,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3c44c6dd >2014-01-30 05:34:25,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: cb46f80 >2014-01-30 05:34:25,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: cb46f80 >2014-01-30 05:34:30,779 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) [4166d263] No up server in cluster >2014-01-30 05:34:30,779 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) [4166d263] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:34:30,781 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) [4166d263] No up server in cluster >2014-01-30 05:34:30,781 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) [4166d263] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:34:30,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 52d13e4d >2014-01-30 05:34:30,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 452db333 >2014-01-30 05:34:31,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 52d13e4d >2014-01-30 05:34:31,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6245eab8 >2014-01-30 05:34:31,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 452db333 >2014-01-30 05:34:31,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1837c84f >2014-01-30 05:34:31,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterTasksListVDSCommand, return: [], log id: 6245eab8 >2014-01-30 05:34:31,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f05813c8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46e0b75d}, log id: 1837c84f >2014-01-30 05:34:31,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 39ff71ff >2014-01-30 05:34:32,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 39ff71ff >2014-01-30 05:34:32,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: dd0648e >2014-01-30 05:34:32,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: dd0648e >2014-01-30 05:34:37,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58401560 >2014-01-30 05:34:37,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 58401560 >2014-01-30 05:34:37,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2afc958f >2014-01-30 05:34:38,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af8f2d34, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e434cb0}, log id: 2afc958f >2014-01-30 05:34:38,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3b9e3f17 >2014-01-30 05:34:38,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3b9e3f17 >2014-01-30 05:34:38,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3fe2c47c >2014-01-30 05:34:39,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3fe2c47c >2014-01-30 05:34:44,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54d0912 >2014-01-30 05:34:44,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 54d0912 >2014-01-30 05:34:44,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b36982b >2014-01-30 05:34:44,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55e6927c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93245721}, log id: 4b36982b >2014-01-30 05:34:44,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7715fe3b >2014-01-30 05:34:45,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7715fe3b >2014-01-30 05:34:45,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d0d235e >2014-01-30 05:34:45,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d0d235e >2014-01-30 05:34:50,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 610d31e6 >2014-01-30 05:34:51,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 610d31e6 >2014-01-30 05:34:51,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d17a70b >2014-01-30 05:34:51,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26461053, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbd45fff}, log id: 7d17a70b >2014-01-30 05:34:51,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2f103952 >2014-01-30 05:34:51,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2f103952 >2014-01-30 05:34:51,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6b4be952 >2014-01-30 05:34:52,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b4be952 >2014-01-30 05:34:56,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b214247 >2014-01-30 05:34:57,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@134539b5, log id: 5b214247 >2014-01-30 05:34:57,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25cfa3f5 >2014-01-30 05:34:57,184 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-4) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 05:34:57,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@141e7cca, log id: 25cfa3f5 >2014-01-30 05:34:57,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d92bc17 >2014-01-30 05:34:57,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5d92bc17 >2014-01-30 05:34:57,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6271cfcf >2014-01-30 05:34:58,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4464dcda, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d20054e}, log id: 6271cfcf >2014-01-30 05:34:58,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 19f925df >2014-01-30 05:34:58,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 19f925df >2014-01-30 05:34:58,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 38aac960 >2014-01-30 05:34:58,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38aac960 >2014-01-30 05:35:03,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9232b7d >2014-01-30 05:35:04,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 9232b7d >2014-01-30 05:35:04,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 576d3130 >2014-01-30 05:35:04,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45f22a1f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43417c06}, log id: 576d3130 >2014-01-30 05:35:04,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2aefa129 >2014-01-30 05:35:05,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2aefa129 >2014-01-30 05:35:05,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1a1a274f >2014-01-30 05:35:05,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a1a274f >2014-01-30 05:35:10,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26dae141 >2014-01-30 05:35:10,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 26dae141 >2014-01-30 05:35:10,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3430bb0 >2014-01-30 05:35:11,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@face8a63, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b75e1ff}, log id: 3430bb0 >2014-01-30 05:35:11,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3938d80f >2014-01-30 05:35:11,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3938d80f >2014-01-30 05:35:11,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7e869349 >2014-01-30 05:35:12,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e869349 >2014-01-30 05:35:17,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e3b0d8d >2014-01-30 05:35:17,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1e3b0d8d >2014-01-30 05:35:17,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25672da5 >2014-01-30 05:35:17,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@205fa97f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83d7136a}, log id: 25672da5 >2014-01-30 05:35:17,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5ba8609a >2014-01-30 05:35:18,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5ba8609a >2014-01-30 05:35:18,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d1f320a >2014-01-30 05:35:18,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d1f320a >2014-01-30 05:35:23,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 608144de >2014-01-30 05:35:24,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 608144de >2014-01-30 05:35:24,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74cee5a4 >2014-01-30 05:35:24,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e91dea36, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b944cfcf}, log id: 74cee5a4 >2014-01-30 05:35:24,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 68eab66f >2014-01-30 05:35:24,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 68eab66f >2014-01-30 05:35:24,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 74209d10 >2014-01-30 05:35:25,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74209d10 >2014-01-30 05:35:30,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17eef57e >2014-01-30 05:35:30,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 17eef57e >2014-01-30 05:35:30,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16979b7d >2014-01-30 05:35:30,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b3ed641, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@addc37d1}, log id: 16979b7d >2014-01-30 05:35:30,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1ece3d0f >2014-01-30 05:35:31,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1ece3d0f >2014-01-30 05:35:31,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 34cf0bbe >2014-01-30 05:35:31,575 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-37) [2a3b7700] No up server in cluster >2014-01-30 05:35:31,575 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:35:31,578 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-37) [2a3b7700] No up server in cluster >2014-01-30 05:35:31,578 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:35:31,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 5e111e3e >2014-01-30 05:35:31,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34cf0bbe >2014-01-30 05:35:32,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 5e111e3e >2014-01-30 05:35:32,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 348c1bd >2014-01-30 05:35:32,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterTasksListVDSCommand, return: [], log id: 348c1bd >2014-01-30 05:35:36,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40b2bcbb >2014-01-30 05:35:37,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 40b2bcbb >2014-01-30 05:35:37,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d22cdda >2014-01-30 05:35:37,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4cf33cf9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac41cfd7}, log id: d22cdda >2014-01-30 05:35:37,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1c160105 >2014-01-30 05:35:38,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1c160105 >2014-01-30 05:35:38,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5f16d496 >2014-01-30 05:35:38,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f16d496 >2014-01-30 05:35:43,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f603a36 >2014-01-30 05:35:43,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1f603a36 >2014-01-30 05:35:43,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52d72536 >2014-01-30 05:35:44,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@175fb592, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2c8907e}, log id: 52d72536 >2014-01-30 05:35:44,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 68f12f3b >2014-01-30 05:35:44,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 68f12f3b >2014-01-30 05:35:44,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 662ad333 >2014-01-30 05:35:44,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 662ad333 >2014-01-30 05:35:49,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5bd48f9b >2014-01-30 05:35:50,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5bd48f9b >2014-01-30 05:35:50,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 93f3b79 >2014-01-30 05:35:50,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@825e2f95, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@246c2299}, log id: 93f3b79 >2014-01-30 05:35:50,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 564ce87 >2014-01-30 05:35:51,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 564ce87 >2014-01-30 05:35:51,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 38d364e0 >2014-01-30 05:35:51,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38d364e0 >2014-01-30 05:35:56,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15155088 >2014-01-30 05:35:56,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 15155088 >2014-01-30 05:35:56,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 757ba7df >2014-01-30 05:35:57,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6afdad0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bf73ab7}, log id: 757ba7df >2014-01-30 05:35:57,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 297c2cc5 >2014-01-30 05:35:57,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 297c2cc5 >2014-01-30 05:35:57,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 40eb71a >2014-01-30 05:35:57,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40eb71a >2014-01-30 05:36:02,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6053f4d6 >2014-01-30 05:36:03,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6053f4d6 >2014-01-30 05:36:03,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e19e1b2 >2014-01-30 05:36:03,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b476da93, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b3fe055}, log id: 4e19e1b2 >2014-01-30 05:36:03,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 692331e5 >2014-01-30 05:36:04,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 692331e5 >2014-01-30 05:36:04,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 785706e4 >2014-01-30 05:36:04,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 785706e4 >2014-01-30 05:36:09,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 70738765 >2014-01-30 05:36:10,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 70738765 >2014-01-30 05:36:10,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 63c65e4f >2014-01-30 05:36:10,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@675274aa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6aeaf3}, log id: 63c65e4f >2014-01-30 05:36:10,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1fd06652 >2014-01-30 05:36:10,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1fd06652 >2014-01-30 05:36:10,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6d5e94ca >2014-01-30 05:36:11,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d5e94ca >2014-01-30 05:36:16,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68e4b2b7 >2014-01-30 05:36:16,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 68e4b2b7 >2014-01-30 05:36:16,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 75830cb8 >2014-01-30 05:36:16,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ea02833, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42b6fdd3}, log id: 75830cb8 >2014-01-30 05:36:16,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 78ceb9de >2014-01-30 05:36:17,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 78ceb9de >2014-01-30 05:36:17,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 46385d80 >2014-01-30 05:36:17,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46385d80 >2014-01-30 05:36:22,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fc345d3 >2014-01-30 05:36:23,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3fc345d3 >2014-01-30 05:36:23,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7aa9f6a5 >2014-01-30 05:36:23,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@196e1472, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3dc45d3a}, log id: 7aa9f6a5 >2014-01-30 05:36:23,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 48ba0ca1 >2014-01-30 05:36:23,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 48ba0ca1 >2014-01-30 05:36:23,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a4678fc >2014-01-30 05:36:24,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a4678fc >2014-01-30 05:36:29,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ae99aa2 >2014-01-30 05:36:29,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2ae99aa2 >2014-01-30 05:36:29,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6777c488 >2014-01-30 05:36:30,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b1c0b2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f51a8ff}, log id: 6777c488 >2014-01-30 05:36:30,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 69d4cd51 >2014-01-30 05:36:30,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 69d4cd51 >2014-01-30 05:36:30,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 41464bca >2014-01-30 05:36:30,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41464bca >2014-01-30 05:36:32,374 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] No up server in cluster >2014-01-30 05:36:32,374 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:36:32,377 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] No up server in cluster >2014-01-30 05:36:32,377 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:36:32,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 158a7c2a >2014-01-30 05:36:32,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 158a7c2a >2014-01-30 05:36:32,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 5003c468 >2014-01-30 05:36:33,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterTasksListVDSCommand, return: [], log id: 5003c468 >2014-01-30 05:36:35,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a98f707 >2014-01-30 05:36:36,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3a98f707 >2014-01-30 05:36:36,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b9507a4 >2014-01-30 05:36:36,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24e19473, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@540a9897}, log id: 3b9507a4 >2014-01-30 05:36:36,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a046298 >2014-01-30 05:36:37,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7a046298 >2014-01-30 05:36:37,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 848751a >2014-01-30 05:36:37,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 848751a >2014-01-30 05:36:42,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8cadde0 >2014-01-30 05:36:42,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 8cadde0 >2014-01-30 05:36:42,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7872fe8b >2014-01-30 05:36:43,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be415809, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fbb38e6}, log id: 7872fe8b >2014-01-30 05:36:43,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7399c713 >2014-01-30 05:36:43,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7399c713 >2014-01-30 05:36:43,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 759644b4 >2014-01-30 05:36:43,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 759644b4 >2014-01-30 05:36:48,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ca94d0a >2014-01-30 05:36:49,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3ca94d0a >2014-01-30 05:36:49,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21a56371 >2014-01-30 05:36:49,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@545a417f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f3c8a8a}, log id: 21a56371 >2014-01-30 05:36:49,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 24b45101 >2014-01-30 05:36:50,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 24b45101 >2014-01-30 05:36:50,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1dcaa54d >2014-01-30 05:36:50,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1dcaa54d >2014-01-30 05:36:55,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25e0a0b5 >2014-01-30 05:36:56,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 25e0a0b5 >2014-01-30 05:36:56,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 190d738b >2014-01-30 05:36:56,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de2e5901, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e76333aa}, log id: 190d738b >2014-01-30 05:36:56,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 36fee126 >2014-01-30 05:36:56,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 36fee126 >2014-01-30 05:36:56,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1fedbe29 >2014-01-30 05:36:57,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fedbe29 >2014-01-30 05:37:02,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1004b7e3 >2014-01-30 05:37:02,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1004b7e3 >2014-01-30 05:37:02,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3afc1b39 >2014-01-30 05:37:02,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce1f7ca3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87225ab5}, log id: 3afc1b39 >2014-01-30 05:37:02,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2849c281 >2014-01-30 05:37:03,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2849c281 >2014-01-30 05:37:03,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4f4f23d3 >2014-01-30 05:37:03,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f4f23d3 >2014-01-30 05:37:08,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1adcd9d4 >2014-01-30 05:37:09,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1adcd9d4 >2014-01-30 05:37:09,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f0ba11f >2014-01-30 05:37:09,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a19296d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@396b9758}, log id: 5f0ba11f >2014-01-30 05:37:09,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1464feac >2014-01-30 05:37:09,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1464feac >2014-01-30 05:37:09,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2e58aa3b >2014-01-30 05:37:10,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e58aa3b >2014-01-30 05:37:15,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f2e2ade >2014-01-30 05:37:15,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: f2e2ade >2014-01-30 05:37:15,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d16cd18 >2014-01-30 05:37:15,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae42932e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16462a35}, log id: 7d16cd18 >2014-01-30 05:37:16,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: fb3ac5 >2014-01-30 05:37:16,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: fb3ac5 >2014-01-30 05:37:16,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 55a77dfb >2014-01-30 05:37:16,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55a77dfb >2014-01-30 05:37:21,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35c38e0b >2014-01-30 05:37:22,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 35c38e0b >2014-01-30 05:37:22,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33b97285 >2014-01-30 05:37:22,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f21cd26, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2a46629}, log id: 33b97285 >2014-01-30 05:37:22,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5ba91c8e >2014-01-30 05:37:23,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5ba91c8e >2014-01-30 05:37:23,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 58f47b03 >2014-01-30 05:37:23,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58f47b03 >2014-01-30 05:37:28,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51c9c452 >2014-01-30 05:37:28,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 51c9c452 >2014-01-30 05:37:28,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f1fcdf7 >2014-01-30 05:37:29,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fa387b0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22d988bc}, log id: 5f1fcdf7 >2014-01-30 05:37:29,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 45f310d0 >2014-01-30 05:37:29,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 45f310d0 >2014-01-30 05:37:29,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 90a6c7a >2014-01-30 05:37:29,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 90a6c7a >2014-01-30 05:37:33,182 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-15) [13272f75] No up server in cluster >2014-01-30 05:37:33,182 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-15) [13272f75] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:37:33,185 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-15) [13272f75] No up server in cluster >2014-01-30 05:37:33,185 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-15) [13272f75] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:37:33,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 97f1d5b >2014-01-30 05:37:33,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 97f1d5b >2014-01-30 05:37:33,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 274794e6 >2014-01-30 05:37:33,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterTasksListVDSCommand, return: [], log id: 274794e6 >2014-01-30 05:37:34,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f451d69 >2014-01-30 05:37:35,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4f451d69 >2014-01-30 05:37:35,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78efb71 >2014-01-30 05:37:35,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34ff878, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73932f24}, log id: 78efb71 >2014-01-30 05:37:35,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ae303ac >2014-01-30 05:37:36,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3ae303ac >2014-01-30 05:37:36,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2ccaa93 >2014-01-30 05:37:36,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ccaa93 >2014-01-30 05:37:41,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 504f7c14 >2014-01-30 05:37:42,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 504f7c14 >2014-01-30 05:37:42,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f318e7f >2014-01-30 05:37:42,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31d16b76, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ff2258c}, log id: 5f318e7f >2014-01-30 05:37:42,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 21de01e6 >2014-01-30 05:37:42,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 21de01e6 >2014-01-30 05:37:42,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: e7b6f2b >2014-01-30 05:37:43,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e7b6f2b >2014-01-30 05:37:48,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 190f105e >2014-01-30 05:37:48,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 190f105e >2014-01-30 05:37:48,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18fef49b >2014-01-30 05:37:48,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b6c1578, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ec70043}, log id: 18fef49b >2014-01-30 05:37:48,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 475109d8 >2014-01-30 05:37:49,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 475109d8 >2014-01-30 05:37:49,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 13577c37 >2014-01-30 05:37:49,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13577c37 >2014-01-30 05:37:54,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5edd8264 >2014-01-30 05:37:55,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5edd8264 >2014-01-30 05:37:55,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25b33ffc >2014-01-30 05:37:55,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8534b5f3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18b7668c}, log id: 25b33ffc >2014-01-30 05:37:55,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ec7d1ba >2014-01-30 05:37:55,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: ec7d1ba >2014-01-30 05:37:55,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7059b270 >2014-01-30 05:37:56,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7059b270 >2014-01-30 05:38:01,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50d91911 >2014-01-30 05:38:01,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 50d91911 >2014-01-30 05:38:01,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4108dc72 >2014-01-30 05:38:02,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ff56780, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f90b089}, log id: 4108dc72 >2014-01-30 05:38:02,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 122fc982 >2014-01-30 05:38:02,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 122fc982 >2014-01-30 05:38:02,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4dcd5f47 >2014-01-30 05:38:02,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4dcd5f47 >2014-01-30 05:38:07,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 213a9a12 >2014-01-30 05:38:08,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 213a9a12 >2014-01-30 05:38:08,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c3ac124 >2014-01-30 05:38:08,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ed9d065, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0d3ac5d}, log id: 4c3ac124 >2014-01-30 05:38:08,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3b790b27 >2014-01-30 05:38:09,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3b790b27 >2014-01-30 05:38:09,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 18307d09 >2014-01-30 05:38:09,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18307d09 >2014-01-30 05:38:14,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31f1b9ad >2014-01-30 05:38:14,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 31f1b9ad >2014-01-30 05:38:14,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2febaf90 >2014-01-30 05:38:15,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc99dd7e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3509708}, log id: 2febaf90 >2014-01-30 05:38:15,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3aae428 >2014-01-30 05:38:15,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3aae428 >2014-01-30 05:38:15,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: b04d339 >2014-01-30 05:38:15,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b04d339 >2014-01-30 05:38:20,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10858c7a >2014-01-30 05:38:21,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 10858c7a >2014-01-30 05:38:21,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b93f7ed >2014-01-30 05:38:21,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@356cee4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8660175f}, log id: 5b93f7ed >2014-01-30 05:38:21,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3bfa65f7 >2014-01-30 05:38:22,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3bfa65f7 >2014-01-30 05:38:22,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 374c4080 >2014-01-30 05:38:22,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 374c4080 >2014-01-30 05:38:27,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 70910257 >2014-01-30 05:38:27,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 70910257 >2014-01-30 05:38:27,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4003b735 >2014-01-30 05:38:28,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f844443, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d91bea76}, log id: 4003b735 >2014-01-30 05:38:28,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 182f8616 >2014-01-30 05:38:28,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 182f8616 >2014-01-30 05:38:28,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 67798843 >2014-01-30 05:38:28,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67798843 >2014-01-30 05:38:34,001 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) [992a9f] No up server in cluster >2014-01-30 05:38:34,001 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) [992a9f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:38:34,004 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) [992a9f] No up server in cluster >2014-01-30 05:38:34,004 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) [992a9f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:38:34,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 7d90695d >2014-01-30 05:38:34,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f03b52c >2014-01-30 05:38:34,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4f03b52c >2014-01-30 05:38:34,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b12fefc >2014-01-30 05:38:34,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 7d90695d >2014-01-30 05:38:34,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 5668967 >2014-01-30 05:38:34,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b45a3ba7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e42b72c}, log id: 3b12fefc >2014-01-30 05:38:34,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1ef32b4d >2014-01-30 05:38:34,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterTasksListVDSCommand, return: [], log id: 5668967 >2014-01-30 05:38:35,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1ef32b4d >2014-01-30 05:38:35,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 410b26a9 >2014-01-30 05:38:35,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 410b26a9 >2014-01-30 05:38:40,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43673d29 >2014-01-30 05:38:40,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43673d29 >2014-01-30 05:38:41,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ff0c2d6 >2014-01-30 05:38:41,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c7373f8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@845a9d6}, log id: 7ff0c2d6 >2014-01-30 05:38:41,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 665c210c >2014-01-30 05:38:41,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 665c210c >2014-01-30 05:38:41,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5996f0d0 >2014-01-30 05:38:42,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5996f0d0 >2014-01-30 05:38:47,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4397f02 >2014-01-30 05:38:47,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4397f02 >2014-01-30 05:38:47,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 431285f1 >2014-01-30 05:38:47,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69817020, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb97219a}, log id: 431285f1 >2014-01-30 05:38:47,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77c81e2e >2014-01-30 05:38:48,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 77c81e2e >2014-01-30 05:38:48,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 566ac65 >2014-01-30 05:38:48,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 566ac65 >2014-01-30 05:38:53,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a72de30 >2014-01-30 05:38:54,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3a72de30 >2014-01-30 05:38:54,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 335df60b >2014-01-30 05:38:54,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@442308b5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37f8151a}, log id: 335df60b >2014-01-30 05:38:54,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7328e309 >2014-01-30 05:38:54,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7328e309 >2014-01-30 05:38:54,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6b0d472 >2014-01-30 05:38:55,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b0d472 >2014-01-30 05:39:00,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 192fcede >2014-01-30 05:39:00,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 192fcede >2014-01-30 05:39:00,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65b48230 >2014-01-30 05:39:00,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f8b918a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2dccdf}, log id: 65b48230 >2014-01-30 05:39:01,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3a088450 >2014-01-30 05:39:01,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3a088450 >2014-01-30 05:39:01,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c11886d >2014-01-30 05:39:01,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c11886d >2014-01-30 05:39:06,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77c7a615 >2014-01-30 05:39:07,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 77c7a615 >2014-01-30 05:39:07,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a511d3c >2014-01-30 05:39:07,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38c5fe14, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0bc6808}, log id: 5a511d3c >2014-01-30 05:39:07,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1ee61f22 >2014-01-30 05:39:08,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1ee61f22 >2014-01-30 05:39:08,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3961155c >2014-01-30 05:39:08,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3961155c >2014-01-30 05:39:13,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59421a0e >2014-01-30 05:39:13,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 59421a0e >2014-01-30 05:39:13,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7224cb29 >2014-01-30 05:39:14,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf18b993, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b92bbd4d}, log id: 7224cb29 >2014-01-30 05:39:14,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7b4c65f3 >2014-01-30 05:39:14,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7b4c65f3 >2014-01-30 05:39:14,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7f7d7ae6 >2014-01-30 05:39:14,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f7d7ae6 >2014-01-30 05:39:19,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6633f631 >2014-01-30 05:39:20,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6633f631 >2014-01-30 05:39:20,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27e134a8 >2014-01-30 05:39:20,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78fc3806, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abf7921b}, log id: 27e134a8 >2014-01-30 05:39:20,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 669427a2 >2014-01-30 05:39:21,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 669427a2 >2014-01-30 05:39:21,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4f4c96f7 >2014-01-30 05:39:21,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f4c96f7 >2014-01-30 05:39:26,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a144ccb >2014-01-30 05:39:26,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a144ccb >2014-01-30 05:39:26,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d06b25c >2014-01-30 05:39:27,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24b928f2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3087ce3}, log id: 4d06b25c >2014-01-30 05:39:27,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: bf59702 >2014-01-30 05:39:27,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: bf59702 >2014-01-30 05:39:27,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 56b7f3e1 >2014-01-30 05:39:27,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56b7f3e1 >2014-01-30 05:39:32,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 448fa135 >2014-01-30 05:39:33,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 448fa135 >2014-01-30 05:39:33,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 534ba844 >2014-01-30 05:39:33,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9dd95dcd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a990cbe}, log id: 534ba844 >2014-01-30 05:39:33,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 28f4a183 >2014-01-30 05:39:34,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 28f4a183 >2014-01-30 05:39:34,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 274e895e >2014-01-30 05:39:34,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 274e895e >2014-01-30 05:39:34,821 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) [3472ce94] No up server in cluster >2014-01-30 05:39:34,821 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) [3472ce94] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:39:34,824 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) [3472ce94] No up server in cluster >2014-01-30 05:39:34,824 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) [3472ce94] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:39:34,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 68504c1e >2014-01-30 05:39:35,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 68504c1e >2014-01-30 05:39:35,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 41040b2b >2014-01-30 05:39:35,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterTasksListVDSCommand, return: [], log id: 41040b2b >2014-01-30 05:39:39,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c9b7423 >2014-01-30 05:39:39,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c9b7423 >2014-01-30 05:39:39,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: bc53197 >2014-01-30 05:39:40,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6dd7c1e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9075408}, log id: bc53197 >2014-01-30 05:39:40,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2a4f5c84 >2014-01-30 05:39:40,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2a4f5c84 >2014-01-30 05:39:40,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3f6ce2d1 >2014-01-30 05:39:40,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f6ce2d1 >2014-01-30 05:39:45,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 725555e9 >2014-01-30 05:39:46,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 725555e9 >2014-01-30 05:39:46,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6bc2399 >2014-01-30 05:39:46,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@954c69f9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@943d69df}, log id: 6bc2399 >2014-01-30 05:39:46,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 74b8ddb >2014-01-30 05:39:47,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 74b8ddb >2014-01-30 05:39:47,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4aeed34e >2014-01-30 05:39:47,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4aeed34e >2014-01-30 05:39:52,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1823b1a >2014-01-30 05:39:52,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1823b1a >2014-01-30 05:39:53,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c771ab2 >2014-01-30 05:39:53,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a665b8b1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fbe8632}, log id: c771ab2 >2014-01-30 05:39:53,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2867a578 >2014-01-30 05:39:53,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2867a578 >2014-01-30 05:39:53,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3466c715 >2014-01-30 05:39:54,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3466c715 >2014-01-30 05:39:57,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 6ccbe7f1 >2014-01-30 05:39:57,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3ac7bfc9, log id: 6ccbe7f1 >2014-01-30 05:39:57,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 10004345 >2014-01-30 05:39:57,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@fd6422a, log id: 10004345 >2014-01-30 05:39:59,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f22a023 >2014-01-30 05:39:59,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1f22a023 >2014-01-30 05:39:59,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c2c99ce >2014-01-30 05:39:59,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d659315e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0fdf1dc}, log id: 2c2c99ce >2014-01-30 05:39:59,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: fdf9cf2 >2014-01-30 05:40:00,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: fdf9cf2 >2014-01-30 05:40:00,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1c7e6d5d >2014-01-30 05:40:00,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c7e6d5d >2014-01-30 05:40:05,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 143a731b >2014-01-30 05:40:06,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 143a731b >2014-01-30 05:40:06,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 116e5c8a >2014-01-30 05:40:06,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fe1471e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0696965}, log id: 116e5c8a >2014-01-30 05:40:06,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c740cf7 >2014-01-30 05:40:06,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5c740cf7 >2014-01-30 05:40:06,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 15e4bcfe >2014-01-30 05:40:07,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15e4bcfe >2014-01-30 05:40:12,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1cc80379 >2014-01-30 05:40:12,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1cc80379 >2014-01-30 05:40:12,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 765bcc23 >2014-01-30 05:40:12,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96c0833a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a830994}, log id: 765bcc23 >2014-01-30 05:40:12,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 576d9893 >2014-01-30 05:40:13,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 576d9893 >2014-01-30 05:40:13,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 18b71b0a >2014-01-30 05:40:13,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18b71b0a >2014-01-30 05:40:18,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56cd218d >2014-01-30 05:40:19,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 56cd218d >2014-01-30 05:40:19,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2bdd14ad >2014-01-30 05:40:19,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aba4fe8b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa63aa66}, log id: 2bdd14ad >2014-01-30 05:40:19,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 32d4a94f >2014-01-30 05:40:19,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 32d4a94f >2014-01-30 05:40:19,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5ff7e4f2 >2014-01-30 05:40:20,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ff7e4f2 >2014-01-30 05:40:25,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f20e4e3 >2014-01-30 05:40:25,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4f20e4e3 >2014-01-30 05:40:25,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ffd549e >2014-01-30 05:40:25,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2946f1b2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a30901e}, log id: 5ffd549e >2014-01-30 05:40:26,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 9472ab4 >2014-01-30 05:40:26,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 9472ab4 >2014-01-30 05:40:26,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 28a5199b >2014-01-30 05:40:26,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28a5199b >2014-01-30 05:40:31,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 415419b5 >2014-01-30 05:40:32,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 415419b5 >2014-01-30 05:40:32,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4764c68f >2014-01-30 05:40:32,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bd62364, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3893d836}, log id: 4764c68f >2014-01-30 05:40:32,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1c1f5272 >2014-01-30 05:40:33,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1c1f5272 >2014-01-30 05:40:33,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c06bc03 >2014-01-30 05:40:33,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c06bc03 >2014-01-30 05:40:35,664 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] No up server in cluster >2014-01-30 05:40:35,664 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:40:35,667 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] No up server in cluster >2014-01-30 05:40:35,667 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:40:35,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 55096dbb >2014-01-30 05:40:36,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 55096dbb >2014-01-30 05:40:36,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 767ca58f >2014-01-30 05:40:36,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterTasksListVDSCommand, return: [], log id: 767ca58f >2014-01-30 05:40:38,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a2d0991 >2014-01-30 05:40:38,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2a2d0991 >2014-01-30 05:40:38,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e634ddc >2014-01-30 05:40:39,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25f32ed1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d9439ec}, log id: 7e634ddc >2014-01-30 05:40:39,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 53e5858a >2014-01-30 05:40:39,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 53e5858a >2014-01-30 05:40:39,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 52f2358d >2014-01-30 05:40:39,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52f2358d >2014-01-30 05:40:44,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9bc8a2b >2014-01-30 05:40:45,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 9bc8a2b >2014-01-30 05:40:45,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37069a89 >2014-01-30 05:40:45,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@655006f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e1efafc}, log id: 37069a89 >2014-01-30 05:40:45,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 132a432c >2014-01-30 05:40:46,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 132a432c >2014-01-30 05:40:46,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6d782311 >2014-01-30 05:40:46,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d782311 >2014-01-30 05:40:51,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1dab7d53 >2014-01-30 05:40:51,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1dab7d53 >2014-01-30 05:40:51,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36aaec15 >2014-01-30 05:40:52,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8c12142, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19615bc1}, log id: 36aaec15 >2014-01-30 05:40:52,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 9996c1d >2014-01-30 05:40:52,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 9996c1d >2014-01-30 05:40:52,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: f62e821 >2014-01-30 05:40:52,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f62e821 >2014-01-30 05:40:58,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 237b9e13 >2014-01-30 05:40:58,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 237b9e13 >2014-01-30 05:40:58,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b1004d1 >2014-01-30 05:40:58,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e533f21a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd44c061}, log id: 4b1004d1 >2014-01-30 05:40:58,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2caab30c >2014-01-30 05:40:59,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2caab30c >2014-01-30 05:40:59,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: b93f947 >2014-01-30 05:40:59,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b93f947 >2014-01-30 05:41:04,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2019fbf6 >2014-01-30 05:41:05,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2019fbf6 >2014-01-30 05:41:05,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79be802f >2014-01-30 05:41:05,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dce1647, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@473f6143}, log id: 79be802f >2014-01-30 05:41:05,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d255afa >2014-01-30 05:41:05,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: d255afa >2014-01-30 05:41:05,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 79f0b1d3 >2014-01-30 05:41:06,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79f0b1d3 >2014-01-30 05:41:11,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2412afc8 >2014-01-30 05:41:11,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2412afc8 >2014-01-30 05:41:11,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 333655fc >2014-01-30 05:41:11,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@761264c3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe07d53f}, log id: 333655fc >2014-01-30 05:41:11,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3def4780 >2014-01-30 05:41:12,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3def4780 >2014-01-30 05:41:12,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65fa52a1 >2014-01-30 05:41:12,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65fa52a1 >2014-01-30 05:41:17,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b6fc432 >2014-01-30 05:41:18,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3b6fc432 >2014-01-30 05:41:18,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b43a9fa >2014-01-30 05:41:18,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa1f9df8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3742c5f5}, log id: 2b43a9fa >2014-01-30 05:41:18,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3d7e59e5 >2014-01-30 05:41:18,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3d7e59e5 >2014-01-30 05:41:18,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3b96e168 >2014-01-30 05:41:19,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b96e168 >2014-01-30 05:41:24,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c10ac91 >2014-01-30 05:41:24,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c10ac91 >2014-01-30 05:41:24,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a0dfeea >2014-01-30 05:41:24,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92817578, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1bba063}, log id: 6a0dfeea >2014-01-30 05:41:25,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1541e98 >2014-01-30 05:41:25,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1541e98 >2014-01-30 05:41:25,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 53a8a411 >2014-01-30 05:41:25,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53a8a411 >2014-01-30 05:41:30,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3478523 >2014-01-30 05:41:31,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3478523 >2014-01-30 05:41:31,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1bae83e4 >2014-01-30 05:41:31,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@666a4005, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18c17e28}, log id: 1bae83e4 >2014-01-30 05:41:31,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 76c1df8a >2014-01-30 05:41:32,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 76c1df8a >2014-01-30 05:41:32,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 936ceb9 >2014-01-30 05:41:32,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 936ceb9 >2014-01-30 05:41:36,505 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-5) [5cab3cac] No up server in cluster >2014-01-30 05:41:36,505 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-5) [5cab3cac] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:41:36,508 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-5) [5cab3cac] No up server in cluster >2014-01-30 05:41:36,508 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-5) [5cab3cac] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:41:36,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 27307e2c >2014-01-30 05:41:37,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 27307e2c >2014-01-30 05:41:37,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: db53ebd >2014-01-30 05:41:37,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 407ae328 >2014-01-30 05:41:37,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterTasksListVDSCommand, return: [], log id: db53ebd >2014-01-30 05:41:37,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 407ae328 >2014-01-30 05:41:37,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6cbb2afc >2014-01-30 05:41:38,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fdee21b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f78f2d2a}, log id: 6cbb2afc >2014-01-30 05:41:38,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 67373c >2014-01-30 05:41:38,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 67373c >2014-01-30 05:41:38,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6376319a >2014-01-30 05:41:38,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6376319a >2014-01-30 05:41:43,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 616ac559 >2014-01-30 05:41:44,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 616ac559 >2014-01-30 05:41:44,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7be1ed0d >2014-01-30 05:41:44,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@136838f4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4aaaa1c}, log id: 7be1ed0d >2014-01-30 05:41:44,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 61f0bb05 >2014-01-30 05:41:45,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 61f0bb05 >2014-01-30 05:41:45,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ffb5d32 >2014-01-30 05:41:45,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ffb5d32 >2014-01-30 05:41:50,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 264f58fe >2014-01-30 05:41:50,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 264f58fe >2014-01-30 05:41:50,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7dd134a6 >2014-01-30 05:41:51,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8993458, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f2df82e}, log id: 7dd134a6 >2014-01-30 05:41:51,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6c4640db >2014-01-30 05:41:51,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6c4640db >2014-01-30 05:41:51,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 68a4fbd1 >2014-01-30 05:41:51,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68a4fbd1 >2014-01-30 05:41:56,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3195665a >2014-01-30 05:41:57,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3195665a >2014-01-30 05:41:57,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c8cd902 >2014-01-30 05:41:57,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df30de98, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@901f2232}, log id: 1c8cd902 >2014-01-30 05:41:57,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2ddb5d63 >2014-01-30 05:41:58,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2ddb5d63 >2014-01-30 05:41:58,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3bb95633 >2014-01-30 05:41:58,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bb95633 >2014-01-30 05:42:03,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 63f92b4d >2014-01-30 05:42:04,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 63f92b4d >2014-01-30 05:42:04,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b064241 >2014-01-30 05:42:04,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9f58bad, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9162e129}, log id: 4b064241 >2014-01-30 05:42:04,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1c9d8897 >2014-01-30 05:42:04,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1c9d8897 >2014-01-30 05:42:04,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7cafc589 >2014-01-30 05:42:05,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cafc589 >2014-01-30 05:42:10,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c63a33e >2014-01-30 05:42:10,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2c63a33e >2014-01-30 05:42:10,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50472b5d >2014-01-30 05:42:10,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@853cb3f7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adb04e75}, log id: 50472b5d >2014-01-30 05:42:10,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 549eacf0 >2014-01-30 05:42:11,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 549eacf0 >2014-01-30 05:42:11,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7b511a2 >2014-01-30 05:42:11,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b511a2 >2014-01-30 05:42:16,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: fe3889d >2014-01-30 05:42:17,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: fe3889d >2014-01-30 05:42:17,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 63abd429 >2014-01-30 05:42:17,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2eff7700, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9ec6e59}, log id: 63abd429 >2014-01-30 05:42:17,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4cca7245 >2014-01-30 05:42:17,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4cca7245 >2014-01-30 05:42:17,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 51a80ef4 >2014-01-30 05:42:18,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51a80ef4 >2014-01-30 05:42:23,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24f3ad15 >2014-01-30 05:42:23,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 24f3ad15 >2014-01-30 05:42:23,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 793fc05c >2014-01-30 05:42:23,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d9684f9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d39ddf0}, log id: 793fc05c >2014-01-30 05:42:23,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 8739195 >2014-01-30 05:42:24,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 8739195 >2014-01-30 05:42:24,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6f65e913 >2014-01-30 05:42:24,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f65e913 >2014-01-30 05:42:29,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 633be81b >2014-01-30 05:42:30,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 633be81b >2014-01-30 05:42:30,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d5856ce >2014-01-30 05:42:30,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47dab0b7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a57c8ecb}, log id: 1d5856ce >2014-01-30 05:42:30,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 27aceeba >2014-01-30 05:42:31,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 27aceeba >2014-01-30 05:42:31,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 39e5b0cf >2014-01-30 05:42:31,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39e5b0cf >2014-01-30 05:42:33,203 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Start refreshing all users data >2014-01-30 05:42:33,255 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-46) [213c04fd] Attempting to update VMs/Templates Ovf. >2014-01-30 05:42:34,912 INFO [org.ovirt.engine.core.bll.LogoutUserCommand] (ajp-/127.0.0.1:8702-11) [ae6ba79] Running command: LogoutUserCommand internal: false. >2014-01-30 05:42:34,912 WARN [org.ovirt.engine.core.branding.BrandingTheme] (ajp-/127.0.0.1:8702-1) Theme /80-rhs-1.brand has no property defined for key resources >2014-01-30 05:42:34,920 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-11) [ae6ba79] Correlation ID: ae6ba79, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged out. >2014-01-30 05:42:36,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a2aefb9 >2014-01-30 05:42:36,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4a2aefb9 >2014-01-30 05:42:36,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 527b6a33 >2014-01-30 05:42:37,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6d6eb9b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e801f2ff}, log id: 527b6a33 >2014-01-30 05:42:37,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4a824539 >2014-01-30 05:42:37,317 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) [4166d263] No up server in cluster >2014-01-30 05:42:37,317 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) [4166d263] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:42:37,321 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) [4166d263] No up server in cluster >2014-01-30 05:42:37,321 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) [4166d263] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:42:37,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 281d16db >2014-01-30 05:42:37,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4a824539 >2014-01-30 05:42:37,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1be5bdbd >2014-01-30 05:42:37,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1be5bdbd >2014-01-30 05:42:37,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 281d16db >2014-01-30 05:42:37,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 1b9f5a79 >2014-01-30 05:42:38,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterTasksListVDSCommand, return: [], log id: 1b9f5a79 >2014-01-30 05:42:42,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38c7bc05 >2014-01-30 05:42:43,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 38c7bc05 >2014-01-30 05:42:43,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25decd36 >2014-01-30 05:42:43,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83dee406, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5274218c}, log id: 25decd36 >2014-01-30 05:42:43,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2c005725 >2014-01-30 05:42:44,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2c005725 >2014-01-30 05:42:44,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2fcd16bf >2014-01-30 05:42:44,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2fcd16bf >2014-01-30 05:42:49,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b961548 >2014-01-30 05:42:49,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4b961548 >2014-01-30 05:42:49,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fe41d1e >2014-01-30 05:42:50,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7d596dd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8cedcbe}, log id: 3fe41d1e >2014-01-30 05:42:50,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 147c875f >2014-01-30 05:42:50,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 147c875f >2014-01-30 05:42:50,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 109439ab >2014-01-30 05:42:50,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 109439ab >2014-01-30 05:42:55,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77066df4 >2014-01-30 05:42:56,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 77066df4 >2014-01-30 05:42:56,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c9c5475 >2014-01-30 05:42:56,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17395f23, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6095138f}, log id: 2c9c5475 >2014-01-30 05:42:56,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 43d83c96 >2014-01-30 05:42:57,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 43d83c96 >2014-01-30 05:42:57,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 127e88c7 >2014-01-30 05:42:57,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 127e88c7 >2014-01-30 05:43:02,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7fa97c89 >2014-01-30 05:43:03,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7fa97c89 >2014-01-30 05:43:03,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a175cc2 >2014-01-30 05:43:03,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb44177e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5d08259}, log id: 2a175cc2 >2014-01-30 05:43:03,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4f7dd67 >2014-01-30 05:43:03,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4f7dd67 >2014-01-30 05:43:03,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6fadb9f4 >2014-01-30 05:43:04,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fadb9f4 >2014-01-30 05:43:09,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 218ddd76 >2014-01-30 05:43:09,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 218ddd76 >2014-01-30 05:43:09,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50184c98 >2014-01-30 05:43:09,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@574690ea, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a84de16}, log id: 50184c98 >2014-01-30 05:43:10,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 719c9bb3 >2014-01-30 05:43:10,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 719c9bb3 >2014-01-30 05:43:10,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7c66ce10 >2014-01-30 05:43:10,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c66ce10 >2014-01-30 05:43:15,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d18105d >2014-01-30 05:43:16,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1d18105d >2014-01-30 05:43:16,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67fece00 >2014-01-30 05:43:16,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5fb61b3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a48ff9e8}, log id: 67fece00 >2014-01-30 05:43:16,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 79d132e4 >2014-01-30 05:43:17,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 79d132e4 >2014-01-30 05:43:17,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1e09ae7b >2014-01-30 05:43:17,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e09ae7b >2014-01-30 05:43:22,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2bf219d7 >2014-01-30 05:43:22,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2bf219d7 >2014-01-30 05:43:22,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 412489df >2014-01-30 05:43:23,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78717231, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0c54207}, log id: 412489df >2014-01-30 05:43:23,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d439d7d >2014-01-30 05:43:23,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7d439d7d >2014-01-30 05:43:23,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d5de45e >2014-01-30 05:43:23,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d5de45e >2014-01-30 05:43:28,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65152deb >2014-01-30 05:43:29,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 65152deb >2014-01-30 05:43:29,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11775ec9 >2014-01-30 05:43:29,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c67de35, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be9b09ff}, log id: 11775ec9 >2014-01-30 05:43:29,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 38ac4422 >2014-01-30 05:43:30,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 38ac4422 >2014-01-30 05:43:30,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65a1cc30 >2014-01-30 05:43:30,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65a1cc30 >2014-01-30 05:43:35,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f3c393a >2014-01-30 05:43:35,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f3c393a >2014-01-30 05:43:35,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: cccc962 >2014-01-30 05:43:36,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39801473, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f290e230}, log id: cccc962 >2014-01-30 05:43:36,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 30821e32 >2014-01-30 05:43:36,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 30821e32 >2014-01-30 05:43:36,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 62fafd74 >2014-01-30 05:43:36,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62fafd74 >2014-01-30 05:43:38,129 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-29) [520212b8] No up server in cluster >2014-01-30 05:43:38,129 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-29) [520212b8] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:43:38,132 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-29) [520212b8] No up server in cluster >2014-01-30 05:43:38,132 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-29) [520212b8] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:43:38,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 515ff660 >2014-01-30 05:43:38,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 515ff660 >2014-01-30 05:43:38,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 26a5cc22 >2014-01-30 05:43:38,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterTasksListVDSCommand, return: [], log id: 26a5cc22 >2014-01-30 05:43:41,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78d92682 >2014-01-30 05:43:42,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 78d92682 >2014-01-30 05:43:42,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 479d062e >2014-01-30 05:43:42,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c1d15f5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62783709}, log id: 479d062e >2014-01-30 05:43:42,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 51e31089 >2014-01-30 05:43:43,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 51e31089 >2014-01-30 05:43:43,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3de7e59b >2014-01-30 05:43:43,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3de7e59b >2014-01-30 05:43:48,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66076884 >2014-01-30 05:43:49,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 66076884 >2014-01-30 05:43:49,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5741cd3e >2014-01-30 05:43:49,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd9949bb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94e18ed1}, log id: 5741cd3e >2014-01-30 05:43:49,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7576eb8c >2014-01-30 05:43:49,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7576eb8c >2014-01-30 05:43:49,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4c12bf17 >2014-01-30 05:43:50,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c12bf17 >2014-01-30 05:43:55,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17dcee22 >2014-01-30 05:43:55,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 17dcee22 >2014-01-30 05:43:55,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b951c2c >2014-01-30 05:43:55,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7828299, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e668f92}, log id: 2b951c2c >2014-01-30 05:43:55,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 78f6091d >2014-01-30 05:43:56,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 78f6091d >2014-01-30 05:43:56,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 85f012e >2014-01-30 05:43:56,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 85f012e >2014-01-30 05:44:01,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 494fde28 >2014-01-30 05:44:02,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 494fde28 >2014-01-30 05:44:02,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c3ec9d6 >2014-01-30 05:44:02,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@229a38f0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7058337e}, log id: c3ec9d6 >2014-01-30 05:44:02,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 33cded14 >2014-01-30 05:44:02,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 33cded14 >2014-01-30 05:44:02,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 12a7693f >2014-01-30 05:44:03,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12a7693f >2014-01-30 05:44:08,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52e6f949 >2014-01-30 05:44:08,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 52e6f949 >2014-01-30 05:44:08,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 423ad6bd >2014-01-30 05:44:09,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2960151, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e5877da}, log id: 423ad6bd >2014-01-30 05:44:09,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5966e810 >2014-01-30 05:44:09,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5966e810 >2014-01-30 05:44:09,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6d644769 >2014-01-30 05:44:09,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d644769 >2014-01-30 05:44:14,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f8b79ab >2014-01-30 05:44:15,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7f8b79ab >2014-01-30 05:44:15,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: fe660c2 >2014-01-30 05:44:15,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85205114, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1faad65}, log id: fe660c2 >2014-01-30 05:44:15,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7e289905 >2014-01-30 05:44:16,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7e289905 >2014-01-30 05:44:16,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 64b98105 >2014-01-30 05:44:16,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64b98105 >2014-01-30 05:44:21,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 216aa5df >2014-01-30 05:44:21,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 216aa5df >2014-01-30 05:44:21,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 707d4fe7 >2014-01-30 05:44:22,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d71cba1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16ccfd8e}, log id: 707d4fe7 >2014-01-30 05:44:22,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7df4437 >2014-01-30 05:44:22,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7df4437 >2014-01-30 05:44:22,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 43cbbee7 >2014-01-30 05:44:22,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43cbbee7 >2014-01-30 05:44:27,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 284de5eb >2014-01-30 05:44:28,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 284de5eb >2014-01-30 05:44:28,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1fa53895 >2014-01-30 05:44:28,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14515980, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0c527fb}, log id: 1fa53895 >2014-01-30 05:44:28,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3296f813 >2014-01-30 05:44:29,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3296f813 >2014-01-30 05:44:29,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 44fd8886 >2014-01-30 05:44:29,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44fd8886 >2014-01-30 05:44:34,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5acec12e >2014-01-30 05:44:34,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5acec12e >2014-01-30 05:44:34,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c3783e1 >2014-01-30 05:44:35,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9948be4a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a6b889f}, log id: 6c3783e1 >2014-01-30 05:44:35,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 70391f73 >2014-01-30 05:44:35,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 70391f73 >2014-01-30 05:44:35,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 293d29ca >2014-01-30 05:44:35,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 293d29ca >2014-01-30 05:44:38,926 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-20) No up server in cluster >2014-01-30 05:44:38,927 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-20) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:44:38,929 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-20) No up server in cluster >2014-01-30 05:44:38,929 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-20) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:44:38,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 13a60d3d >2014-01-30 05:44:39,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 13a60d3d >2014-01-30 05:44:39,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 41949fe3 >2014-01-30 05:44:39,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterTasksListVDSCommand, return: [], log id: 41949fe3 >2014-01-30 05:44:40,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c07189a >2014-01-30 05:44:41,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2c07189a >2014-01-30 05:44:41,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f25da25 >2014-01-30 05:44:41,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b095db5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26281b88}, log id: 6f25da25 >2014-01-30 05:44:41,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3040a590 >2014-01-30 05:44:42,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3040a590 >2014-01-30 05:44:42,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 845ccf >2014-01-30 05:44:42,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 845ccf >2014-01-30 05:44:47,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ed54fce >2014-01-30 05:44:47,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3ed54fce >2014-01-30 05:44:47,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 348cc8ac >2014-01-30 05:44:48,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d54dade, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af72b005}, log id: 348cc8ac >2014-01-30 05:44:48,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2253870f >2014-01-30 05:44:48,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2253870f >2014-01-30 05:44:48,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 8260bb6 >2014-01-30 05:44:48,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8260bb6 >2014-01-30 05:44:54,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7719755f >2014-01-30 05:44:54,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7719755f >2014-01-30 05:44:54,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a0201ff >2014-01-30 05:44:54,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6526ff, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23d30add}, log id: 1a0201ff >2014-01-30 05:44:54,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2df31443 >2014-01-30 05:44:55,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2df31443 >2014-01-30 05:44:55,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 694d01fa >2014-01-30 05:44:55,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 694d01fa >2014-01-30 05:44:58,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 522461f4 >2014-01-30 05:44:58,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7a68355c, log id: 522461f4 >2014-01-30 05:44:58,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f8769cc >2014-01-30 05:44:58,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4275ac3f, log id: 4f8769cc >2014-01-30 05:45:00,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b663e91 >2014-01-30 05:45:01,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4b663e91 >2014-01-30 05:45:01,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29096170 >2014-01-30 05:45:01,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c1c7fcd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60bdf962}, log id: 29096170 >2014-01-30 05:45:01,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 76266f37 >2014-01-30 05:45:01,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 76266f37 >2014-01-30 05:45:01,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 71ca815a >2014-01-30 05:45:02,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71ca815a >2014-01-30 05:45:07,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ba7bb41 >2014-01-30 05:45:07,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4ba7bb41 >2014-01-30 05:45:07,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22dffd59 >2014-01-30 05:45:07,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e29eab23, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48e62c6a}, log id: 22dffd59 >2014-01-30 05:45:07,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 23a184f1 >2014-01-30 05:45:08,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 23a184f1 >2014-01-30 05:45:08,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5ef36258 >2014-01-30 05:45:08,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ef36258 >2014-01-30 05:45:13,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 673e1f70 >2014-01-30 05:45:14,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 673e1f70 >2014-01-30 05:45:14,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 299bc1d5 >2014-01-30 05:45:14,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6cbc962, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2841994a}, log id: 299bc1d5 >2014-01-30 05:45:14,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 27221b10 >2014-01-30 05:45:14,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 27221b10 >2014-01-30 05:45:14,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 38823dfc >2014-01-30 05:45:15,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38823dfc >2014-01-30 05:45:20,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5592f6ad >2014-01-30 05:45:20,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5592f6ad >2014-01-30 05:45:20,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 130a436d >2014-01-30 05:45:21,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be8426a6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1835402}, log id: 130a436d >2014-01-30 05:45:21,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1d642140 >2014-01-30 05:45:21,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1d642140 >2014-01-30 05:45:21,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1ae1c211 >2014-01-30 05:45:21,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ae1c211 >2014-01-30 05:45:26,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 185ccafb >2014-01-30 05:45:27,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 185ccafb >2014-01-30 05:45:27,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a3ed9fe >2014-01-30 05:45:27,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6464fb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f08998f}, log id: 7a3ed9fe >2014-01-30 05:45:27,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 12971520 >2014-01-30 05:45:28,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 12971520 >2014-01-30 05:45:28,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6da62276 >2014-01-30 05:45:28,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6da62276 >2014-01-30 05:45:33,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7af2cc97 >2014-01-30 05:45:33,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7af2cc97 >2014-01-30 05:45:33,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 707f34f9 >2014-01-30 05:45:34,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cecccbf4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1818aa}, log id: 707f34f9 >2014-01-30 05:45:34,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 22dc2e4b >2014-01-30 05:45:34,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 22dc2e4b >2014-01-30 05:45:34,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 129476e0 >2014-01-30 05:45:34,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 129476e0 >2014-01-30 05:45:39,764 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) [213c04fd] No up server in cluster >2014-01-30 05:45:39,764 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) [213c04fd] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:45:39,767 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-46) [213c04fd] No up server in cluster >2014-01-30 05:45:39,767 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-46) [213c04fd] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:45:39,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f739074 >2014-01-30 05:45:39,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 440ac6eb >2014-01-30 05:45:40,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 6f739074 >2014-01-30 05:45:40,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3fc1c1e7 >2014-01-30 05:45:40,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 440ac6eb >2014-01-30 05:45:40,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c260b69 >2014-01-30 05:45:40,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterTasksListVDSCommand, return: [], log id: 3fc1c1e7 >2014-01-30 05:45:40,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f19871dd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@958427e6}, log id: 2c260b69 >2014-01-30 05:45:40,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 10a9b995 >2014-01-30 05:45:41,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 10a9b995 >2014-01-30 05:45:41,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 55932c97 >2014-01-30 05:45:41,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55932c97 >2014-01-30 05:45:46,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a91544f >2014-01-30 05:45:46,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1a91544f >2014-01-30 05:45:46,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e7687cc >2014-01-30 05:45:47,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd35bb71, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be026399}, log id: 1e7687cc >2014-01-30 05:45:47,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1755224d >2014-01-30 05:45:47,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1755224d >2014-01-30 05:45:47,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 68797747 >2014-01-30 05:45:47,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68797747 >2014-01-30 05:45:52,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e1b0e03 >2014-01-30 05:45:53,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4e1b0e03 >2014-01-30 05:45:53,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 251238d7 >2014-01-30 05:45:53,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9783e55, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3c97f6e}, log id: 251238d7 >2014-01-30 05:45:53,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4049a6c2 >2014-01-30 05:45:54,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4049a6c2 >2014-01-30 05:45:54,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: be2c22e >2014-01-30 05:45:54,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: be2c22e >2014-01-30 05:45:59,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 62845994 >2014-01-30 05:46:00,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 62845994 >2014-01-30 05:46:00,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c767d2d >2014-01-30 05:46:00,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@985074e4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccc75ae}, log id: 7c767d2d >2014-01-30 05:46:00,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7b01ba5f >2014-01-30 05:46:00,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7b01ba5f >2014-01-30 05:46:00,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5b337160 >2014-01-30 05:46:01,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b337160 >2014-01-30 05:46:06,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44327124 >2014-01-30 05:46:06,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 44327124 >2014-01-30 05:46:06,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6528f0d0 >2014-01-30 05:46:06,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@509d21ed, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d7f6ca9}, log id: 6528f0d0 >2014-01-30 05:46:06,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 653bf2a9 >2014-01-30 05:46:07,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 653bf2a9 >2014-01-30 05:46:07,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 44b614a4 >2014-01-30 05:46:07,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44b614a4 >2014-01-30 05:46:12,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43c8d39a >2014-01-30 05:46:13,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43c8d39a >2014-01-30 05:46:13,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60d08451 >2014-01-30 05:46:13,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18826b12, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b29ff19}, log id: 60d08451 >2014-01-30 05:46:13,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 50b37c71 >2014-01-30 05:46:13,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 50b37c71 >2014-01-30 05:46:13,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 30450f4 >2014-01-30 05:46:14,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30450f4 >2014-01-30 05:46:19,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66536885 >2014-01-30 05:46:19,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 66536885 >2014-01-30 05:46:19,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44b465f >2014-01-30 05:46:19,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff86c1db, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c0514d8}, log id: 44b465f >2014-01-30 05:46:19,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b0dbe5e >2014-01-30 05:46:20,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2b0dbe5e >2014-01-30 05:46:20,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 49e14534 >2014-01-30 05:46:20,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49e14534 >2014-01-30 05:46:25,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78077415 >2014-01-30 05:46:26,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 78077415 >2014-01-30 05:46:26,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a90f966 >2014-01-30 05:46:26,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3efa4076, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35f08765}, log id: a90f966 >2014-01-30 05:46:26,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77f20e44 >2014-01-30 05:46:27,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 77f20e44 >2014-01-30 05:46:27,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4a82d979 >2014-01-30 05:46:27,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a82d979 >2014-01-30 05:46:32,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16f39570 >2014-01-30 05:46:32,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 16f39570 >2014-01-30 05:46:32,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9f9a3d8 >2014-01-30 05:46:33,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3eb3ab2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2567ea16}, log id: 9f9a3d8 >2014-01-30 05:46:33,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 56e411ec >2014-01-30 05:46:33,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 56e411ec >2014-01-30 05:46:33,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 741fe433 >2014-01-30 05:46:33,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 741fe433 >2014-01-30 05:46:38,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 561ac6b3 >2014-01-30 05:46:39,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 561ac6b3 >2014-01-30 05:46:39,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 789f578c >2014-01-30 05:46:39,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3082c5ea, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a16942a}, log id: 789f578c >2014-01-30 05:46:39,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 35b793b1 >2014-01-30 05:46:40,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 35b793b1 >2014-01-30 05:46:40,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 29ef8429 >2014-01-30 05:46:40,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29ef8429 >2014-01-30 05:46:40,516 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-1) [6b51df7a] No up server in cluster >2014-01-30 05:46:40,517 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-1) [6b51df7a] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:46:40,519 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-1) [6b51df7a] No up server in cluster >2014-01-30 05:46:40,519 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-1) [6b51df7a] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:46:40,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f63ca47 >2014-01-30 05:46:41,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4f63ca47 >2014-01-30 05:46:41,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6755b272 >2014-01-30 05:46:41,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterTasksListVDSCommand, return: [], log id: 6755b272 >2014-01-30 05:46:45,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1fe33f5d >2014-01-30 05:46:45,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1fe33f5d >2014-01-30 05:46:45,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5000a0ae >2014-01-30 05:46:46,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@118ccb82, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b50c1a3e}, log id: 5000a0ae >2014-01-30 05:46:46,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 64ae1f16 >2014-01-30 05:46:46,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 64ae1f16 >2014-01-30 05:46:46,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 49c753e1 >2014-01-30 05:46:46,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49c753e1 >2014-01-30 05:46:51,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50d829f4 >2014-01-30 05:46:52,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 50d829f4 >2014-01-30 05:46:52,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22ed57d8 >2014-01-30 05:46:52,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10a19a1a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39f98885}, log id: 22ed57d8 >2014-01-30 05:46:52,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7873685b >2014-01-30 05:46:53,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7873685b >2014-01-30 05:46:53,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2039724e >2014-01-30 05:46:53,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2039724e >2014-01-30 05:46:58,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 28f6fcff >2014-01-30 05:46:59,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 28f6fcff >2014-01-30 05:46:59,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 57c0e968 >2014-01-30 05:46:59,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88135f3b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e345ed1}, log id: 57c0e968 >2014-01-30 05:46:59,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 56b2aa59 >2014-01-30 05:46:59,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 56b2aa59 >2014-01-30 05:46:59,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3c3479bd >2014-01-30 05:47:00,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c3479bd >2014-01-30 05:47:05,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1dc2a76b >2014-01-30 05:47:05,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1dc2a76b >2014-01-30 05:47:05,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 346705e9 >2014-01-30 05:47:05,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4de4da98, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b8a7bfa}, log id: 346705e9 >2014-01-30 05:47:05,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: b4f61fb >2014-01-30 05:47:06,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: b4f61fb >2014-01-30 05:47:06,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2c4505af >2014-01-30 05:47:06,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c4505af >2014-01-30 05:47:11,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 587c5bd3 >2014-01-30 05:47:12,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 587c5bd3 >2014-01-30 05:47:12,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b192c4c >2014-01-30 05:47:12,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8defa25, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da6d6223}, log id: 7b192c4c >2014-01-30 05:47:12,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 64f34021 >2014-01-30 05:47:12,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 64f34021 >2014-01-30 05:47:12,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 798dadf4 >2014-01-30 05:47:13,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 798dadf4 >2014-01-30 05:47:18,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43693f6a >2014-01-30 05:47:18,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43693f6a >2014-01-30 05:47:18,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a475f5f >2014-01-30 05:47:19,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c997f7e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fca4df08}, log id: a475f5f >2014-01-30 05:47:19,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 18fe52a2 >2014-01-30 05:47:19,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 18fe52a2 >2014-01-30 05:47:19,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ec9ca0a >2014-01-30 05:47:19,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ec9ca0a >2014-01-30 05:47:24,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a835f92 >2014-01-30 05:47:25,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6a835f92 >2014-01-30 05:47:25,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a4d67eb >2014-01-30 05:47:25,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad41fb59, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce5a4757}, log id: 3a4d67eb >2014-01-30 05:47:26,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1a719061 >2014-01-30 05:47:26,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1a719061 >2014-01-30 05:47:26,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a98fabb >2014-01-30 05:47:26,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a98fabb >2014-01-30 05:47:31,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68859a26 >2014-01-30 05:47:32,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 68859a26 >2014-01-30 05:47:32,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4af76c56 >2014-01-30 05:47:32,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cfed802, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76900793}, log id: 4af76c56 >2014-01-30 05:47:32,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 50a2fd05 >2014-01-30 05:47:33,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 50a2fd05 >2014-01-30 05:47:33,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1cd338ef >2014-01-30 05:47:33,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cd338ef >2014-01-30 05:47:38,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 652c5f6f >2014-01-30 05:47:38,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 652c5f6f >2014-01-30 05:47:38,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a11d2a0 >2014-01-30 05:47:39,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d821a775, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8a200b6}, log id: 5a11d2a0 >2014-01-30 05:47:39,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e8ed38c >2014-01-30 05:47:39,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4e8ed38c >2014-01-30 05:47:39,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 49ba2a88 >2014-01-30 05:47:39,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49ba2a88 >2014-01-30 05:47:41,331 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-82) [4eafa082] No up server in cluster >2014-01-30 05:47:41,331 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-82) [4eafa082] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:47:41,334 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-82) [4eafa082] No up server in cluster >2014-01-30 05:47:41,334 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-82) [4eafa082] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:47:41,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 327a076f >2014-01-30 05:47:41,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 327a076f >2014-01-30 05:47:41,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 544bf098 >2014-01-30 05:47:42,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterTasksListVDSCommand, return: [], log id: 544bf098 >2014-01-30 05:47:44,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b780fe6 >2014-01-30 05:47:45,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2b780fe6 >2014-01-30 05:47:45,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5732c6cd >2014-01-30 05:47:45,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f26ef802, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dbd2b50e}, log id: 5732c6cd >2014-01-30 05:47:45,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 28e86dba >2014-01-30 05:47:46,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 28e86dba >2014-01-30 05:47:46,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6944ce2 >2014-01-30 05:47:46,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6944ce2 >2014-01-30 05:47:51,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ee800df >2014-01-30 05:47:52,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6ee800df >2014-01-30 05:47:52,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66d5ecd >2014-01-30 05:47:52,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e86f55ec, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f2bb701}, log id: 66d5ecd >2014-01-30 05:47:52,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2fcad32e >2014-01-30 05:47:52,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2fcad32e >2014-01-30 05:47:52,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 64ac3b4f >2014-01-30 05:47:53,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64ac3b4f >2014-01-30 05:47:58,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79354ce2 >2014-01-30 05:47:58,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 79354ce2 >2014-01-30 05:47:58,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3674eabf >2014-01-30 05:47:58,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1dee097d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@608beb2a}, log id: 3674eabf >2014-01-30 05:47:58,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6040993c >2014-01-30 05:47:59,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6040993c >2014-01-30 05:47:59,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5e3a6b82 >2014-01-30 05:47:59,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e3a6b82 >2014-01-30 05:48:04,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a4ed319 >2014-01-30 05:48:05,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3a4ed319 >2014-01-30 05:48:05,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e5a7dda >2014-01-30 05:48:05,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60ef8be2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb118bd7}, log id: e5a7dda >2014-01-30 05:48:05,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 508c83e0 >2014-01-30 05:48:05,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 508c83e0 >2014-01-30 05:48:05,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 531d03b8 >2014-01-30 05:48:06,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 531d03b8 >2014-01-30 05:48:11,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 608d9de3 >2014-01-30 05:48:11,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 608d9de3 >2014-01-30 05:48:11,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f1e7c1b >2014-01-30 05:48:12,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43196b9d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@572cb306}, log id: 3f1e7c1b >2014-01-30 05:48:12,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3971dd01 >2014-01-30 05:48:12,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3971dd01 >2014-01-30 05:48:12,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4f5aa20a >2014-01-30 05:48:12,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f5aa20a >2014-01-30 05:48:17,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 732f7275 >2014-01-30 05:48:18,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 732f7275 >2014-01-30 05:48:18,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27746318 >2014-01-30 05:48:18,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e042b1f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67b13c79}, log id: 27746318 >2014-01-30 05:48:18,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 35716f92 >2014-01-30 05:48:19,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 35716f92 >2014-01-30 05:48:19,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1c7fe249 >2014-01-30 05:48:19,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c7fe249 >2014-01-30 05:48:24,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30fbff29 >2014-01-30 05:48:24,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 30fbff29 >2014-01-30 05:48:24,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 675b9492 >2014-01-30 05:48:25,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47e2119a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@442809e6}, log id: 675b9492 >2014-01-30 05:48:25,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 49cecd6f >2014-01-30 05:48:25,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 49cecd6f >2014-01-30 05:48:25,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 67825cd2 >2014-01-30 05:48:25,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67825cd2 >2014-01-30 05:48:30,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 219121a3 >2014-01-30 05:48:31,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 219121a3 >2014-01-30 05:48:31,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 518f4d8b >2014-01-30 05:48:31,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e519b6c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f382c183}, log id: 518f4d8b >2014-01-30 05:48:31,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 226d143c >2014-01-30 05:48:32,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 226d143c >2014-01-30 05:48:32,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4fb05e93 >2014-01-30 05:48:32,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fb05e93 >2014-01-30 05:48:37,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16c096ec >2014-01-30 05:48:37,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 16c096ec >2014-01-30 05:48:38,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2262964f >2014-01-30 05:48:38,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b27d36, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cbd86d7}, log id: 2262964f >2014-01-30 05:48:38,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 293598fc >2014-01-30 05:48:38,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 293598fc >2014-01-30 05:48:38,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5bdbbb6a >2014-01-30 05:48:39,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5bdbbb6a >2014-01-30 05:48:42,144 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-27) [1194a119] No up server in cluster >2014-01-30 05:48:42,144 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-27) [1194a119] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:48:42,148 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-27) [1194a119] No up server in cluster >2014-01-30 05:48:42,148 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-27) [1194a119] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:48:42,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 2283ff04 >2014-01-30 05:48:42,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 2283ff04 >2014-01-30 05:48:42,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3d2610fa >2014-01-30 05:48:42,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterTasksListVDSCommand, return: [], log id: 3d2610fa >2014-01-30 05:48:44,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d80f6d7 >2014-01-30 05:48:44,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: d80f6d7 >2014-01-30 05:48:44,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e147d11 >2014-01-30 05:48:44,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3ffea91, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51dfa5e1}, log id: 6e147d11 >2014-01-30 05:48:44,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7925ddcb >2014-01-30 05:48:45,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7925ddcb >2014-01-30 05:48:45,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6c2352d8 >2014-01-30 05:48:45,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c2352d8 >2014-01-30 05:48:50,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 460e55d9 >2014-01-30 05:48:51,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 460e55d9 >2014-01-30 05:48:51,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6de91e3 >2014-01-30 05:48:51,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23b9c5f9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe11e585}, log id: 6de91e3 >2014-01-30 05:48:51,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3fa5ba2f >2014-01-30 05:48:51,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3fa5ba2f >2014-01-30 05:48:51,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 564e8f91 >2014-01-30 05:48:52,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 564e8f91 >2014-01-30 05:48:57,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ca3a9dc >2014-01-30 05:48:57,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: ca3a9dc >2014-01-30 05:48:57,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2de863ab >2014-01-30 05:48:57,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df588dba, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b00aa6d}, log id: 2de863ab >2014-01-30 05:48:58,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7257ffea >2014-01-30 05:48:58,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7257ffea >2014-01-30 05:48:58,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 673ff5e5 >2014-01-30 05:48:58,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 673ff5e5 >2014-01-30 05:49:03,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3057ef78 >2014-01-30 05:49:04,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3057ef78 >2014-01-30 05:49:04,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b0b6219 >2014-01-30 05:49:04,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24f30ce, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c962a1e1}, log id: 2b0b6219 >2014-01-30 05:49:04,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 551c765c >2014-01-30 05:49:05,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 551c765c >2014-01-30 05:49:05,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 450b85eb >2014-01-30 05:49:05,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 450b85eb >2014-01-30 05:49:10,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 309facb8 >2014-01-30 05:49:10,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 309facb8 >2014-01-30 05:49:10,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b7df82a >2014-01-30 05:49:11,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d68c2115, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe14f314}, log id: 5b7df82a >2014-01-30 05:49:11,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 750aef2c >2014-01-30 05:49:11,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 750aef2c >2014-01-30 05:49:11,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 757a5b9 >2014-01-30 05:49:11,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 757a5b9 >2014-01-30 05:49:16,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b2b1a38 >2014-01-30 05:49:17,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6b2b1a38 >2014-01-30 05:49:17,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42ef2bf5 >2014-01-30 05:49:17,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3f07c9f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@117eff31}, log id: 42ef2bf5 >2014-01-30 05:49:17,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 725b63ee >2014-01-30 05:49:18,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 725b63ee >2014-01-30 05:49:18,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6468466d >2014-01-30 05:49:18,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6468466d >2014-01-30 05:49:23,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79957788 >2014-01-30 05:49:23,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 79957788 >2014-01-30 05:49:23,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1537fca5 >2014-01-30 05:49:24,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2119e153, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7c938bb}, log id: 1537fca5 >2014-01-30 05:49:24,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 492f96e2 >2014-01-30 05:49:24,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 492f96e2 >2014-01-30 05:49:24,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3cdbefaf >2014-01-30 05:49:25,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cdbefaf >2014-01-30 05:49:30,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5291d541 >2014-01-30 05:49:30,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5291d541 >2014-01-30 05:49:30,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f0cd2df >2014-01-30 05:49:30,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5a2c374, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e1bfd99}, log id: 2f0cd2df >2014-01-30 05:49:30,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: dd0dbd8 >2014-01-30 05:49:31,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: dd0dbd8 >2014-01-30 05:49:31,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5e002cfa >2014-01-30 05:49:31,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e002cfa >2014-01-30 05:49:36,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43e16c01 >2014-01-30 05:49:37,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43e16c01 >2014-01-30 05:49:37,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ba7eae5 >2014-01-30 05:49:37,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7c6fd3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c081983e}, log id: 1ba7eae5 >2014-01-30 05:49:37,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4a632bd9 >2014-01-30 05:49:37,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4a632bd9 >2014-01-30 05:49:37,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 280f1899 >2014-01-30 05:49:38,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 280f1899 >2014-01-30 05:49:42,977 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] No up server in cluster >2014-01-30 05:49:42,977 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:49:42,981 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] No up server in cluster >2014-01-30 05:49:42,981 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:49:42,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4565a30b >2014-01-30 05:49:43,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74a5db56 >2014-01-30 05:49:43,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4565a30b >2014-01-30 05:49:43,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 4b2c1ceb >2014-01-30 05:49:43,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 74a5db56 >2014-01-30 05:49:43,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5aadc733 >2014-01-30 05:49:43,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterTasksListVDSCommand, return: [], log id: 4b2c1ceb >2014-01-30 05:49:43,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e41888d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@295ce297}, log id: 5aadc733 >2014-01-30 05:49:43,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 19f3924d >2014-01-30 05:49:44,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 19f3924d >2014-01-30 05:49:44,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2754a206 >2014-01-30 05:49:44,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2754a206 >2014-01-30 05:49:49,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f7db33f >2014-01-30 05:49:50,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4f7db33f >2014-01-30 05:49:50,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ded7cf1 >2014-01-30 05:49:50,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@434864ab, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8c6e424}, log id: 3ded7cf1 >2014-01-30 05:49:50,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4b5dad82 >2014-01-30 05:49:51,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4b5dad82 >2014-01-30 05:49:51,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1ddc5b15 >2014-01-30 05:49:51,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ddc5b15 >2014-01-30 05:49:56,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 163af479 >2014-01-30 05:49:56,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 163af479 >2014-01-30 05:49:56,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16b0387c >2014-01-30 05:49:57,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9896e09d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e04a429e}, log id: 16b0387c >2014-01-30 05:49:57,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5f97619e >2014-01-30 05:49:57,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5f97619e >2014-01-30 05:49:57,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 72a00e72 >2014-01-30 05:49:57,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72a00e72 >2014-01-30 05:49:58,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 32238f2c >2014-01-30 05:49:58,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1748d8e2, log id: 32238f2c >2014-01-30 05:49:58,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 2f96e95f >2014-01-30 05:49:59,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@69ff5877, log id: 2f96e95f >2014-01-30 05:50:02,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e30558c >2014-01-30 05:50:03,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e30558c >2014-01-30 05:50:03,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 612da28c >2014-01-30 05:50:03,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9161e61e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2da9b4f3}, log id: 612da28c >2014-01-30 05:50:03,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 64693f4e >2014-01-30 05:50:04,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 64693f4e >2014-01-30 05:50:04,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 677c58a >2014-01-30 05:50:04,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 677c58a >2014-01-30 05:50:09,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67aa1104 >2014-01-30 05:50:09,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 67aa1104 >2014-01-30 05:50:09,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2cefcc28 >2014-01-30 05:50:10,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da2f97ac, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58c96259}, log id: 2cefcc28 >2014-01-30 05:50:10,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4fa54cd6 >2014-01-30 05:50:10,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4fa54cd6 >2014-01-30 05:50:10,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5f193fd3 >2014-01-30 05:50:10,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f193fd3 >2014-01-30 05:50:15,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42ae6fd4 >2014-01-30 05:50:16,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 42ae6fd4 >2014-01-30 05:50:16,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2cfc762 >2014-01-30 05:50:16,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cb9e159, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b59d019}, log id: 2cfc762 >2014-01-30 05:50:16,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5f7cfac3 >2014-01-30 05:50:17,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5f7cfac3 >2014-01-30 05:50:17,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 32e9d14e >2014-01-30 05:50:17,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32e9d14e >2014-01-30 05:50:22,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2be5097c >2014-01-30 05:50:23,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2be5097c >2014-01-30 05:50:23,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b3f9f48 >2014-01-30 05:50:23,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63dd1672, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3ba6e01}, log id: 1b3f9f48 >2014-01-30 05:50:23,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3f4577a6 >2014-01-30 05:50:23,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3f4577a6 >2014-01-30 05:50:23,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5eb77394 >2014-01-30 05:50:24,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5eb77394 >2014-01-30 05:50:29,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8caf76e >2014-01-30 05:50:29,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 8caf76e >2014-01-30 05:50:29,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d4c6946 >2014-01-30 05:50:29,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fdeffc51, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1319b88f}, log id: 6d4c6946 >2014-01-30 05:50:29,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 11b48081 >2014-01-30 05:50:30,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 11b48081 >2014-01-30 05:50:30,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 121ef7cf >2014-01-30 05:50:30,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 121ef7cf >2014-01-30 05:50:35,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a7fb401 >2014-01-30 05:50:36,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2a7fb401 >2014-01-30 05:50:36,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 213f2756 >2014-01-30 05:50:36,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@478a4f5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a85f3a64}, log id: 213f2756 >2014-01-30 05:50:36,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 491ad21c >2014-01-30 05:50:37,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 491ad21c >2014-01-30 05:50:37,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4a9e3e94 >2014-01-30 05:50:37,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a9e3e94 >2014-01-30 05:50:42,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: bbc0565 >2014-01-30 05:50:42,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: bbc0565 >2014-01-30 05:50:42,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53e4c869 >2014-01-30 05:50:43,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb9175f7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4f7749c}, log id: 53e4c869 >2014-01-30 05:50:43,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 25c702b3 >2014-01-30 05:50:43,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 25c702b3 >2014-01-30 05:50:43,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: be2089a >2014-01-30 05:50:43,762 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-68) No up server in cluster >2014-01-30 05:50:43,763 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-68) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:50:43,765 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-68) No up server in cluster >2014-01-30 05:50:43,765 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-68) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:50:43,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5cbec670 >2014-01-30 05:50:43,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: be2089a >2014-01-30 05:50:44,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 5cbec670 >2014-01-30 05:50:44,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 378410d0 >2014-01-30 05:50:44,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterTasksListVDSCommand, return: [], log id: 378410d0 >2014-01-30 05:50:48,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ee092a8 >2014-01-30 05:50:49,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2ee092a8 >2014-01-30 05:50:49,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41277945 >2014-01-30 05:50:49,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9601156c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d92151c}, log id: 41277945 >2014-01-30 05:50:49,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 37fed50 >2014-01-30 05:50:50,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 37fed50 >2014-01-30 05:50:50,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 47b50bb6 >2014-01-30 05:50:50,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47b50bb6 >2014-01-30 05:50:55,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26b17eed >2014-01-30 05:50:55,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 26b17eed >2014-01-30 05:50:55,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1cc71026 >2014-01-30 05:50:56,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a46b298, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c4a9880}, log id: 1cc71026 >2014-01-30 05:50:56,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7177d244 >2014-01-30 05:50:56,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7177d244 >2014-01-30 05:50:56,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1e54c79f >2014-01-30 05:50:56,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e54c79f >2014-01-30 05:51:02,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7fe173be >2014-01-30 05:51:02,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7fe173be >2014-01-30 05:51:02,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 366ad474 >2014-01-30 05:51:02,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e166da6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efa66058}, log id: 366ad474 >2014-01-30 05:51:02,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 42204f23 >2014-01-30 05:51:03,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 42204f23 >2014-01-30 05:51:03,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 53089991 >2014-01-30 05:51:03,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53089991 >2014-01-30 05:51:08,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33f148b6 >2014-01-30 05:51:09,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 33f148b6 >2014-01-30 05:51:09,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 332bebea >2014-01-30 05:51:09,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8a33080, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f6c95ed}, log id: 332bebea >2014-01-30 05:51:09,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 380c4445 >2014-01-30 05:51:09,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 380c4445 >2014-01-30 05:51:09,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 37b28593 >2014-01-30 05:51:10,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37b28593 >2014-01-30 05:51:15,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5328146f >2014-01-30 05:51:15,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5328146f >2014-01-30 05:51:15,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5795d624 >2014-01-30 05:51:15,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38eef33, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a78abaa9}, log id: 5795d624 >2014-01-30 05:51:15,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7fed94f6 >2014-01-30 05:51:16,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7fed94f6 >2014-01-30 05:51:16,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: b3a2690 >2014-01-30 05:51:16,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b3a2690 >2014-01-30 05:51:21,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 482538cd >2014-01-30 05:51:22,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 482538cd >2014-01-30 05:51:22,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a5f2b1f >2014-01-30 05:51:22,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5defbcf4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5042e3fe}, log id: 3a5f2b1f >2014-01-30 05:51:22,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 40b77f9d >2014-01-30 05:51:22,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 40b77f9d >2014-01-30 05:51:22,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4d415c25 >2014-01-30 05:51:23,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d415c25 >2014-01-30 05:51:28,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5291789b >2014-01-30 05:51:28,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5291789b >2014-01-30 05:51:28,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13671cf7 >2014-01-30 05:51:28,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89ae4fa7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc26ff00}, log id: 13671cf7 >2014-01-30 05:51:29,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b273e49 >2014-01-30 05:51:29,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2b273e49 >2014-01-30 05:51:29,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 15e0a798 >2014-01-30 05:51:29,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15e0a798 >2014-01-30 05:51:34,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77c6d305 >2014-01-30 05:51:35,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 77c6d305 >2014-01-30 05:51:35,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78edb3ff >2014-01-30 05:51:35,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51df5f0f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0c3de64}, log id: 78edb3ff >2014-01-30 05:51:35,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 46d074a0 >2014-01-30 05:51:36,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 46d074a0 >2014-01-30 05:51:36,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: b12b8c9 >2014-01-30 05:51:36,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b12b8c9 >2014-01-30 05:51:41,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b1e2932 >2014-01-30 05:51:41,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1b1e2932 >2014-01-30 05:51:41,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a707266 >2014-01-30 05:51:42,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4535a9a4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ee895d}, log id: a707266 >2014-01-30 05:51:42,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1d0be525 >2014-01-30 05:51:42,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1d0be525 >2014-01-30 05:51:42,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3d3e8f05 >2014-01-30 05:51:42,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d3e8f05 >2014-01-30 05:51:44,599 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) [70a1c224] No up server in cluster >2014-01-30 05:51:44,599 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) [70a1c224] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:51:44,602 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) [70a1c224] No up server in cluster >2014-01-30 05:51:44,603 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) [70a1c224] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:51:44,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16340f0c >2014-01-30 05:51:45,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 16340f0c >2014-01-30 05:51:45,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 25691691 >2014-01-30 05:51:45,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterTasksListVDSCommand, return: [], log id: 25691691 >2014-01-30 05:51:47,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 697e3edb >2014-01-30 05:51:48,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 697e3edb >2014-01-30 05:51:48,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1295f160 >2014-01-30 05:51:48,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da39facd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef83dfc2}, log id: 1295f160 >2014-01-30 05:51:48,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6f176a80 >2014-01-30 05:51:49,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6f176a80 >2014-01-30 05:51:49,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1cfe669e >2014-01-30 05:51:49,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cfe669e >2014-01-30 05:51:54,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1cb16fd3 >2014-01-30 05:51:54,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1cb16fd3 >2014-01-30 05:51:54,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4df60fa6 >2014-01-30 05:51:55,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e21349f1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dba4bf43}, log id: 4df60fa6 >2014-01-30 05:51:55,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1fcc38bd >2014-01-30 05:51:55,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1fcc38bd >2014-01-30 05:51:55,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 131ca053 >2014-01-30 05:51:55,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 131ca053 >2014-01-30 05:52:00,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 167df2f9 >2014-01-30 05:52:01,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 167df2f9 >2014-01-30 05:52:01,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b9e245c >2014-01-30 05:52:01,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89b6a531, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed39ecff}, log id: 7b9e245c >2014-01-30 05:52:01,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7458d101 >2014-01-30 05:52:02,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7458d101 >2014-01-30 05:52:02,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2a5e8951 >2014-01-30 05:52:02,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a5e8951 >2014-01-30 05:52:07,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50f9c18b >2014-01-30 05:52:08,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 50f9c18b >2014-01-30 05:52:08,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 260d18d4 >2014-01-30 05:52:08,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec712114, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8fc47e0}, log id: 260d18d4 >2014-01-30 05:52:08,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5b1ff47b >2014-01-30 05:52:08,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5b1ff47b >2014-01-30 05:52:08,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1f121226 >2014-01-30 05:52:09,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f121226 >2014-01-30 05:52:14,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e159dc3 >2014-01-30 05:52:14,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7e159dc3 >2014-01-30 05:52:14,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3dd41bbb >2014-01-30 05:52:14,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c00cdf37, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@358baebd}, log id: 3dd41bbb >2014-01-30 05:52:14,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2674d5ad >2014-01-30 05:52:15,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2674d5ad >2014-01-30 05:52:15,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2de1ffe0 >2014-01-30 05:52:15,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2de1ffe0 >2014-01-30 05:52:20,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18e6d0a7 >2014-01-30 05:52:21,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 18e6d0a7 >2014-01-30 05:52:21,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ea7a59a >2014-01-30 05:52:21,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@419c93ad, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac52771}, log id: 1ea7a59a >2014-01-30 05:52:21,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7747642c >2014-01-30 05:52:21,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7747642c >2014-01-30 05:52:21,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4c05da45 >2014-01-30 05:52:22,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c05da45 >2014-01-30 05:52:27,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: df4d24d >2014-01-30 05:52:27,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: df4d24d >2014-01-30 05:52:27,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fe865f6 >2014-01-30 05:52:27,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac4d3640, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@520802f9}, log id: 3fe865f6 >2014-01-30 05:52:28,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 87e45bb >2014-01-30 05:52:28,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 87e45bb >2014-01-30 05:52:28,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e6eac4b >2014-01-30 05:52:28,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e6eac4b >2014-01-30 05:52:33,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5537bd3d >2014-01-30 05:52:34,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5537bd3d >2014-01-30 05:52:34,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 323dfc97 >2014-01-30 05:52:34,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc5da095, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f421e73}, log id: 323dfc97 >2014-01-30 05:52:34,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1326d60c >2014-01-30 05:52:35,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1326d60c >2014-01-30 05:52:35,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 239d3702 >2014-01-30 05:52:35,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 239d3702 >2014-01-30 05:52:40,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c7ddcc7 >2014-01-30 05:52:40,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3c7ddcc7 >2014-01-30 05:52:40,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6fc817fb >2014-01-30 05:52:41,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f20baeb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d286aafa}, log id: 6fc817fb >2014-01-30 05:52:41,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1c95c040 >2014-01-30 05:52:41,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1c95c040 >2014-01-30 05:52:41,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 64241922 >2014-01-30 05:52:41,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64241922 >2014-01-30 05:52:45,442 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-39) No up server in cluster >2014-01-30 05:52:45,443 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-39) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:52:45,445 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-39) No up server in cluster >2014-01-30 05:52:45,445 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-39) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:52:45,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 412c44 >2014-01-30 05:52:45,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 412c44 >2014-01-30 05:52:45,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 330f8f7e >2014-01-30 05:52:46,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterTasksListVDSCommand, return: [], log id: 330f8f7e >2014-01-30 05:52:46,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4899ff80 >2014-01-30 05:52:47,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4899ff80 >2014-01-30 05:52:47,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b6eec1f >2014-01-30 05:52:47,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70441ec5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c1064cb}, log id: b6eec1f >2014-01-30 05:52:47,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 46140765 >2014-01-30 05:52:48,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 46140765 >2014-01-30 05:52:48,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 55583845 >2014-01-30 05:52:48,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55583845 >2014-01-30 05:52:53,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 70bdafbb >2014-01-30 05:52:53,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 70bdafbb >2014-01-30 05:52:53,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e96cdbc >2014-01-30 05:52:54,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bda4341c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@220e9d06}, log id: 6e96cdbc >2014-01-30 05:52:54,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 29e318f0 >2014-01-30 05:52:54,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 29e318f0 >2014-01-30 05:52:54,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2eea1d3a >2014-01-30 05:52:55,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2eea1d3a >2014-01-30 05:53:00,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 244fac7d >2014-01-30 05:53:00,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 244fac7d >2014-01-30 05:53:00,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e6757ec >2014-01-30 05:53:00,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99f45848, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4bb23f55}, log id: 5e6757ec >2014-01-30 05:53:00,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2c0a34c0 >2014-01-30 05:53:01,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2c0a34c0 >2014-01-30 05:53:01,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 198508fa >2014-01-30 05:53:01,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 198508fa >2014-01-30 05:53:06,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d154123 >2014-01-30 05:53:07,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6d154123 >2014-01-30 05:53:07,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2144cc1a >2014-01-30 05:53:07,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7b72a23, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f3e6aa0}, log id: 2144cc1a >2014-01-30 05:53:07,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5eba89fd >2014-01-30 05:53:07,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5eba89fd >2014-01-30 05:53:07,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 520005bb >2014-01-30 05:53:08,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 520005bb >2014-01-30 05:53:13,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5037823c >2014-01-30 05:53:13,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5037823c >2014-01-30 05:53:13,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e6b362d >2014-01-30 05:53:13,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32ee0631, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b5fdda6}, log id: 6e6b362d >2014-01-30 05:53:13,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5173e929 >2014-01-30 05:53:14,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5173e929 >2014-01-30 05:53:14,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 8e7e759 >2014-01-30 05:53:14,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8e7e759 >2014-01-30 05:53:19,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 81b92d7 >2014-01-30 05:53:20,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 81b92d7 >2014-01-30 05:53:20,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 215dee53 >2014-01-30 05:53:20,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7b30475, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ed5293a}, log id: 215dee53 >2014-01-30 05:53:20,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4bfbdf62 >2014-01-30 05:53:20,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4bfbdf62 >2014-01-30 05:53:20,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3a0d3f6b >2014-01-30 05:53:21,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a0d3f6b >2014-01-30 05:53:26,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48e7b4e3 >2014-01-30 05:53:26,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 48e7b4e3 >2014-01-30 05:53:26,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 28931595 >2014-01-30 05:53:27,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84ebc2f2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70cb88df}, log id: 28931595 >2014-01-30 05:53:27,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3e714aad >2014-01-30 05:53:27,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3e714aad >2014-01-30 05:53:27,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 96f80b7 >2014-01-30 05:53:27,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 96f80b7 >2014-01-30 05:53:32,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2de8b10f >2014-01-30 05:53:33,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2de8b10f >2014-01-30 05:53:33,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15beb861 >2014-01-30 05:53:33,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23332648, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4813a4a}, log id: 15beb861 >2014-01-30 05:53:33,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 76f24b32 >2014-01-30 05:53:34,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 76f24b32 >2014-01-30 05:53:34,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 43097428 >2014-01-30 05:53:34,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43097428 >2014-01-30 05:53:39,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69d8fae2 >2014-01-30 05:53:39,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 69d8fae2 >2014-01-30 05:53:39,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e687374 >2014-01-30 05:53:40,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17fbc729, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b397cd51}, log id: 5e687374 >2014-01-30 05:53:40,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 573ffc74 >2014-01-30 05:53:40,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 573ffc74 >2014-01-30 05:53:40,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 8c0d3b9 >2014-01-30 05:53:40,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8c0d3b9 >2014-01-30 05:53:45,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b4bd4f1 >2014-01-30 05:53:46,250 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-22) [6f443883] No up server in cluster >2014-01-30 05:53:46,250 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-22) [6f443883] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:53:46,252 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-22) [6f443883] No up server in cluster >2014-01-30 05:53:46,253 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-22) [6f443883] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:53:46,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 6520e62d >2014-01-30 05:53:46,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b4bd4f1 >2014-01-30 05:53:46,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36829686 >2014-01-30 05:53:46,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50c2ec6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccd7d168}, log id: 36829686 >2014-01-30 05:53:46,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7ed03fa0 >2014-01-30 05:53:46,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 6520e62d >2014-01-30 05:53:46,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 250a079d >2014-01-30 05:53:47,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterTasksListVDSCommand, return: [], log id: 250a079d >2014-01-30 05:53:47,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7ed03fa0 >2014-01-30 05:53:47,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 398d6aee >2014-01-30 05:53:47,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 398d6aee >2014-01-30 05:53:52,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d661590 >2014-01-30 05:53:52,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3d661590 >2014-01-30 05:53:52,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ac7ca3c >2014-01-30 05:53:53,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ebc204a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4191d35d}, log id: ac7ca3c >2014-01-30 05:53:53,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 24b87f4f >2014-01-30 05:53:53,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 24b87f4f >2014-01-30 05:53:53,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 576a1abd >2014-01-30 05:53:53,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 576a1abd >2014-01-30 05:53:58,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2446907e >2014-01-30 05:53:59,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2446907e >2014-01-30 05:53:59,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 694f015f >2014-01-30 05:53:59,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6d7b22a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a254d877}, log id: 694f015f >2014-01-30 05:53:59,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 67a556d6 >2014-01-30 05:54:00,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 67a556d6 >2014-01-30 05:54:00,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3e0efc6c >2014-01-30 05:54:00,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e0efc6c >2014-01-30 05:54:05,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13f2bbab >2014-01-30 05:54:05,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 13f2bbab >2014-01-30 05:54:05,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4223d306 >2014-01-30 05:54:06,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f97ece6c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d747d44b}, log id: 4223d306 >2014-01-30 05:54:06,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 42c317a8 >2014-01-30 05:54:06,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 42c317a8 >2014-01-30 05:54:06,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4783cb2e >2014-01-30 05:54:07,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4783cb2e >2014-01-30 05:54:12,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d4cd2c8 >2014-01-30 05:54:12,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7d4cd2c8 >2014-01-30 05:54:12,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 261e86f3 >2014-01-30 05:54:12,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34258974, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eae6cc6e}, log id: 261e86f3 >2014-01-30 05:54:12,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e2b3fd5 >2014-01-30 05:54:13,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4e2b3fd5 >2014-01-30 05:54:13,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4a345f70 >2014-01-30 05:54:13,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a345f70 >2014-01-30 05:54:18,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65362d9f >2014-01-30 05:54:19,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 65362d9f >2014-01-30 05:54:19,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58d7dd60 >2014-01-30 05:54:19,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55baccaa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc5c006e}, log id: 58d7dd60 >2014-01-30 05:54:19,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3225b929 >2014-01-30 05:54:19,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3225b929 >2014-01-30 05:54:19,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 447fe5f8 >2014-01-30 05:54:20,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 447fe5f8 >2014-01-30 05:54:25,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7443696c >2014-01-30 05:54:25,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7443696c >2014-01-30 05:54:25,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 276a204f >2014-01-30 05:54:25,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e97b7a44, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4176125}, log id: 276a204f >2014-01-30 05:54:25,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3a2ad9c1 >2014-01-30 05:54:26,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3a2ad9c1 >2014-01-30 05:54:26,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77011aa3 >2014-01-30 05:54:26,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77011aa3 >2014-01-30 05:54:31,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3dbf6714 >2014-01-30 05:54:32,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3dbf6714 >2014-01-30 05:54:32,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66b143e7 >2014-01-30 05:54:32,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c72f9d8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1169886}, log id: 66b143e7 >2014-01-30 05:54:32,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6da30f7d >2014-01-30 05:54:33,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6da30f7d >2014-01-30 05:54:33,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 73d7b19a >2014-01-30 05:54:33,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73d7b19a >2014-01-30 05:54:38,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4490cbe1 >2014-01-30 05:54:38,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4490cbe1 >2014-01-30 05:54:38,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a344715 >2014-01-30 05:54:39,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfb0ccb1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe621ae}, log id: a344715 >2014-01-30 05:54:39,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 51cb2fd1 >2014-01-30 05:54:39,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 51cb2fd1 >2014-01-30 05:54:39,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c345b66 >2014-01-30 05:54:39,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c345b66 >2014-01-30 05:54:44,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a3361a2 >2014-01-30 05:54:45,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2a3361a2 >2014-01-30 05:54:45,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 694e6f8c >2014-01-30 05:54:45,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@503aab19, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96b0d743}, log id: 694e6f8c >2014-01-30 05:54:45,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 15340367 >2014-01-30 05:54:46,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 15340367 >2014-01-30 05:54:46,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5380287f >2014-01-30 05:54:46,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5380287f >2014-01-30 05:54:47,032 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-84) [2ccca513] No up server in cluster >2014-01-30 05:54:47,032 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-84) [2ccca513] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:54:47,035 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-84) [2ccca513] No up server in cluster >2014-01-30 05:54:47,035 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-84) [2ccca513] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:54:47,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d0393a >2014-01-30 05:54:47,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 7d0393a >2014-01-30 05:54:47,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 172b3d45 >2014-01-30 05:54:47,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterTasksListVDSCommand, return: [], log id: 172b3d45 >2014-01-30 05:54:51,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 119af22f >2014-01-30 05:54:51,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 119af22f >2014-01-30 05:54:51,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5de55651 >2014-01-30 05:54:52,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@695e4bb9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ef8362e}, log id: 5de55651 >2014-01-30 05:54:52,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 979753 >2014-01-30 05:54:52,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 979753 >2014-01-30 05:54:52,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2754fdc1 >2014-01-30 05:54:52,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2754fdc1 >2014-01-30 05:54:57,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c0aa112 >2014-01-30 05:54:58,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c0aa112 >2014-01-30 05:54:58,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 108ef09e >2014-01-30 05:54:58,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0a5e02e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1ff3deb}, log id: 108ef09e >2014-01-30 05:54:58,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 138b14c5 >2014-01-30 05:54:59,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 5209187d >2014-01-30 05:54:59,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 138b14c5 >2014-01-30 05:54:59,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 68dfe4c6 >2014-01-30 05:54:59,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68dfe4c6 >2014-01-30 05:54:59,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@417d1c86, log id: 5209187d >2014-01-30 05:54:59,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 7cdbc300 >2014-01-30 05:54:59,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@24025118, log id: 7cdbc300 >2014-01-30 05:55:04,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c5cdd8a >2014-01-30 05:55:04,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3c5cdd8a >2014-01-30 05:55:04,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56d57a08 >2014-01-30 05:55:05,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d83ccede, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5733597e}, log id: 56d57a08 >2014-01-30 05:55:05,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 17b6f80d >2014-01-30 05:55:05,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 17b6f80d >2014-01-30 05:55:05,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5ef420de >2014-01-30 05:55:05,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ef420de >2014-01-30 05:55:11,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f321958 >2014-01-30 05:55:11,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f321958 >2014-01-30 05:55:11,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36b9e212 >2014-01-30 05:55:11,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@397f7762, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f07ea30}, log id: 36b9e212 >2014-01-30 05:55:11,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d514ec3 >2014-01-30 05:55:12,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7d514ec3 >2014-01-30 05:55:12,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5bde844 >2014-01-30 05:55:12,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5bde844 >2014-01-30 05:55:17,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33233855 >2014-01-30 05:55:18,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 33233855 >2014-01-30 05:55:18,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f4e6515 >2014-01-30 05:55:18,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9b73da1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dda1a581}, log id: 2f4e6515 >2014-01-30 05:55:18,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 490fffc >2014-01-30 05:55:18,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 490fffc >2014-01-30 05:55:18,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ba31bd0 >2014-01-30 05:55:19,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ba31bd0 >2014-01-30 05:55:24,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78182a2f >2014-01-30 05:55:24,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 78182a2f >2014-01-30 05:55:24,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5403fcae >2014-01-30 05:55:24,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b025e9f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5f13327}, log id: 5403fcae >2014-01-30 05:55:24,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ab6650d >2014-01-30 05:55:25,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3ab6650d >2014-01-30 05:55:25,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: a56686 >2014-01-30 05:55:25,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a56686 >2014-01-30 05:55:30,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20189ef6 >2014-01-30 05:55:31,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 20189ef6 >2014-01-30 05:55:31,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e44259d >2014-01-30 05:55:31,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb9883f1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@292c7f4d}, log id: 3e44259d >2014-01-30 05:55:31,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 212a9256 >2014-01-30 05:55:32,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 212a9256 >2014-01-30 05:55:32,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1b88248f >2014-01-30 05:55:32,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b88248f >2014-01-30 05:55:37,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a1e4eef >2014-01-30 05:55:37,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a1e4eef >2014-01-30 05:55:37,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42b3c164 >2014-01-30 05:55:38,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f008c300, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec1e4e01}, log id: 42b3c164 >2014-01-30 05:55:38,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1ecbb592 >2014-01-30 05:55:38,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1ecbb592 >2014-01-30 05:55:38,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4b047c95 >2014-01-30 05:55:38,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b047c95 >2014-01-30 05:55:43,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f1bb9d9 >2014-01-30 05:55:44,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6f1bb9d9 >2014-01-30 05:55:44,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a2081d7 >2014-01-30 05:55:44,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2a7d217, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d73d50d7}, log id: 7a2081d7 >2014-01-30 05:55:44,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1a320c4a >2014-01-30 05:55:45,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1a320c4a >2014-01-30 05:55:45,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 596b6bda >2014-01-30 05:55:45,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 596b6bda >2014-01-30 05:55:47,871 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-76) [5b01de2c] No up server in cluster >2014-01-30 05:55:47,872 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-76) [5b01de2c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:55:47,875 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-76) [5b01de2c] No up server in cluster >2014-01-30 05:55:47,875 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-76) [5b01de2c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:55:47,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1125b9d0 >2014-01-30 05:55:48,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 1125b9d0 >2014-01-30 05:55:48,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 4bb5cc04 >2014-01-30 05:55:48,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterTasksListVDSCommand, return: [], log id: 4bb5cc04 >2014-01-30 05:55:50,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2488535a >2014-01-30 05:55:50,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2488535a >2014-01-30 05:55:50,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d9e7bc9 >2014-01-30 05:55:51,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d86486ae, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0eb4e38}, log id: 2d9e7bc9 >2014-01-30 05:55:51,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ac251a >2014-01-30 05:55:51,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3ac251a >2014-01-30 05:55:51,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 79242a69 >2014-01-30 05:55:52,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79242a69 >2014-01-30 05:55:57,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1cffc359 >2014-01-30 05:55:57,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1cffc359 >2014-01-30 05:55:57,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d0fc8ac >2014-01-30 05:55:57,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0dda0ab, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e875cb88}, log id: 2d0fc8ac >2014-01-30 05:55:57,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1b86a077 >2014-01-30 05:55:58,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1b86a077 >2014-01-30 05:55:58,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 18f68e64 >2014-01-30 05:55:58,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18f68e64 >2014-01-30 05:56:03,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 412347b8 >2014-01-30 05:56:04,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 412347b8 >2014-01-30 05:56:04,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30354d7a >2014-01-30 05:56:04,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14dbaf0a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@332ce52a}, log id: 30354d7a >2014-01-30 05:56:04,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7b789ca3 >2014-01-30 05:56:04,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7b789ca3 >2014-01-30 05:56:04,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6bc3487a >2014-01-30 05:56:05,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6bc3487a >2014-01-30 05:56:10,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5073dfd7 >2014-01-30 05:56:10,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5073dfd7 >2014-01-30 05:56:10,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6402e91e >2014-01-30 05:56:11,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77a47a56, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e31f54e3}, log id: 6402e91e >2014-01-30 05:56:11,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4334bdfa >2014-01-30 05:56:11,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4334bdfa >2014-01-30 05:56:11,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5426818d >2014-01-30 05:56:11,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5426818d >2014-01-30 05:56:16,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f8b2aa8 >2014-01-30 05:56:17,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4f8b2aa8 >2014-01-30 05:56:17,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f50a6c2 >2014-01-30 05:56:17,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@400ea278, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a25ca30}, log id: 4f50a6c2 >2014-01-30 05:56:17,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3b2ba3d0 >2014-01-30 05:56:18,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3b2ba3d0 >2014-01-30 05:56:18,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 37256ca3 >2014-01-30 05:56:18,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37256ca3 >2014-01-30 05:56:23,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c51ba73 >2014-01-30 05:56:23,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1c51ba73 >2014-01-30 05:56:23,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 656f2e2e >2014-01-30 05:56:24,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8d91dd6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@246136ba}, log id: 656f2e2e >2014-01-30 05:56:24,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 287c867f >2014-01-30 05:56:24,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 287c867f >2014-01-30 05:56:24,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 994c3a6 >2014-01-30 05:56:24,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 994c3a6 >2014-01-30 05:56:29,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41716c04 >2014-01-30 05:56:30,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 41716c04 >2014-01-30 05:56:30,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 505745 >2014-01-30 05:56:30,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b920575, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@925bc244}, log id: 505745 >2014-01-30 05:56:30,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 473df329 >2014-01-30 05:56:31,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 473df329 >2014-01-30 05:56:31,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c11f71f >2014-01-30 05:56:31,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c11f71f >2014-01-30 05:56:36,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16f37ed4 >2014-01-30 05:56:37,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 16f37ed4 >2014-01-30 05:56:37,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 45b3f911 >2014-01-30 05:56:37,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d126c5bb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6ca734d}, log id: 45b3f911 >2014-01-30 05:56:37,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 696fa2bb >2014-01-30 05:56:37,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 696fa2bb >2014-01-30 05:56:37,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 477c21d >2014-01-30 05:56:38,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 477c21d >2014-01-30 05:56:43,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7de0960a >2014-01-30 05:56:43,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7de0960a >2014-01-30 05:56:43,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3035215c >2014-01-30 05:56:43,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@305300be, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64af834b}, log id: 3035215c >2014-01-30 05:56:43,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2d1f57b5 >2014-01-30 05:56:44,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2d1f57b5 >2014-01-30 05:56:44,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5ceeb74a >2014-01-30 05:56:44,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ceeb74a >2014-01-30 05:56:48,706 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-74) [61851da7] No up server in cluster >2014-01-30 05:56:48,706 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-74) [61851da7] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:56:48,709 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-74) [61851da7] No up server in cluster >2014-01-30 05:56:48,709 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-74) [61851da7] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:56:48,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 199b9dd8 >2014-01-30 05:56:49,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 199b9dd8 >2014-01-30 05:56:49,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 36b64a04 >2014-01-30 05:56:49,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterTasksListVDSCommand, return: [], log id: 36b64a04 >2014-01-30 05:56:49,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38594db9 >2014-01-30 05:56:50,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 38594db9 >2014-01-30 05:56:50,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1675635a >2014-01-30 05:56:50,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb6b7e80, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a82fd4c4}, log id: 1675635a >2014-01-30 05:56:50,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5e596b2 >2014-01-30 05:56:50,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5e596b2 >2014-01-30 05:56:50,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 29f41bff >2014-01-30 05:56:51,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29f41bff >2014-01-30 05:56:56,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20b1914e >2014-01-30 05:56:56,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 20b1914e >2014-01-30 05:56:56,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1794e9a0 >2014-01-30 05:56:56,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@acd00ac1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4d72398}, log id: 1794e9a0 >2014-01-30 05:56:56,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4acfefa7 >2014-01-30 05:56:57,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4acfefa7 >2014-01-30 05:56:57,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 125e20e2 >2014-01-30 05:56:57,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 125e20e2 >2014-01-30 05:57:02,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7eb0ce39 >2014-01-30 05:57:03,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7eb0ce39 >2014-01-30 05:57:03,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 505ddf05 >2014-01-30 05:57:03,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e87458aa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b778f9b5}, log id: 505ddf05 >2014-01-30 05:57:03,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d15c8c >2014-01-30 05:57:03,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7d15c8c >2014-01-30 05:57:03,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5aaa4792 >2014-01-30 05:57:04,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5aaa4792 >2014-01-30 05:57:09,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 187deb3b >2014-01-30 05:57:09,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 187deb3b >2014-01-30 05:57:09,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25aaca45 >2014-01-30 05:57:10,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e566618c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85b90407}, log id: 25aaca45 >2014-01-30 05:57:10,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7f16d68e >2014-01-30 05:57:10,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7f16d68e >2014-01-30 05:57:10,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: fad5b7 >2014-01-30 05:57:10,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fad5b7 >2014-01-30 05:57:15,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74521afd >2014-01-30 05:57:16,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 74521afd >2014-01-30 05:57:16,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77c84f06 >2014-01-30 05:57:16,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4af1d6e7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bc7aad}, log id: 77c84f06 >2014-01-30 05:57:16,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4fedbaec >2014-01-30 05:57:17,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4fedbaec >2014-01-30 05:57:17,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4f4dce2a >2014-01-30 05:57:17,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f4dce2a >2014-01-30 05:57:22,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c25c0e4 >2014-01-30 05:57:22,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5c25c0e4 >2014-01-30 05:57:22,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e4cfa75 >2014-01-30 05:57:23,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45291baa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@126a8b5e}, log id: 7e4cfa75 >2014-01-30 05:57:23,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 64c07d35 >2014-01-30 05:57:23,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 64c07d35 >2014-01-30 05:57:23,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 517ea942 >2014-01-30 05:57:23,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 517ea942 >2014-01-30 05:57:28,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 414ce38 >2014-01-30 05:57:29,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 414ce38 >2014-01-30 05:57:29,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6714a88e >2014-01-30 05:57:29,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95b795ad, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d96c0e7}, log id: 6714a88e >2014-01-30 05:57:29,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 69fd9f75 >2014-01-30 05:57:30,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 69fd9f75 >2014-01-30 05:57:30,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 44cc64f4 >2014-01-30 05:57:30,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44cc64f4 >2014-01-30 05:57:35,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 34e19b3e >2014-01-30 05:57:35,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 34e19b3e >2014-01-30 05:57:35,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 61634dcd >2014-01-30 05:57:36,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1566be8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64197067}, log id: 61634dcd >2014-01-30 05:57:36,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 336eff42 >2014-01-30 05:57:36,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 336eff42 >2014-01-30 05:57:36,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4897f4de >2014-01-30 05:57:36,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4897f4de >2014-01-30 05:57:41,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2baee0d1 >2014-01-30 05:57:42,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2baee0d1 >2014-01-30 05:57:42,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c298387 >2014-01-30 05:57:42,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52fefb91, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed41f403}, log id: 2c298387 >2014-01-30 05:57:42,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 71ecca2b >2014-01-30 05:57:43,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 71ecca2b >2014-01-30 05:57:43,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7407cfb3 >2014-01-30 05:57:43,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7407cfb3 >2014-01-30 05:57:48,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78b377e7 >2014-01-30 05:57:49,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 78b377e7 >2014-01-30 05:57:49,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58eef53c >2014-01-30 05:57:49,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e84210, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52f0e145}, log id: 58eef53c >2014-01-30 05:57:49,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 76e88d9c >2014-01-30 05:57:49,541 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) [5049497] No up server in cluster >2014-01-30 05:57:49,541 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) [5049497] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:57:49,544 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) [5049497] No up server in cluster >2014-01-30 05:57:49,544 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) [5049497] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:57:49,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 69d42830 >2014-01-30 05:57:49,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 76e88d9c >2014-01-30 05:57:49,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 171baf2f >2014-01-30 05:57:50,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 69d42830 >2014-01-30 05:57:50,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 78878e57 >2014-01-30 05:57:50,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 171baf2f >2014-01-30 05:57:50,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterTasksListVDSCommand, return: [], log id: 78878e57 >2014-01-30 05:57:55,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2046d25c >2014-01-30 05:57:55,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2046d25c >2014-01-30 05:57:55,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 439aecfd >2014-01-30 05:57:55,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76b6136e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64ea15c3}, log id: 439aecfd >2014-01-30 05:57:55,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 60992515 >2014-01-30 05:57:56,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 60992515 >2014-01-30 05:57:56,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5162a341 >2014-01-30 05:57:56,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5162a341 >2014-01-30 05:58:01,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1471d23c >2014-01-30 05:58:02,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1471d23c >2014-01-30 05:58:02,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 389c8dce >2014-01-30 05:58:02,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@536d9a62, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a39fe4ab}, log id: 389c8dce >2014-01-30 05:58:02,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5db115b3 >2014-01-30 05:58:02,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5db115b3 >2014-01-30 05:58:02,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2616bf9b >2014-01-30 05:58:03,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2616bf9b >2014-01-30 05:58:08,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6feab7a9 >2014-01-30 05:58:08,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6feab7a9 >2014-01-30 05:58:08,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b8941 >2014-01-30 05:58:09,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccfe1a0b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89ecd503}, log id: 2b8941 >2014-01-30 05:58:09,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 28a68c0f >2014-01-30 05:58:09,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 28a68c0f >2014-01-30 05:58:09,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2ce3497a >2014-01-30 05:58:09,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ce3497a >2014-01-30 05:58:14,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b46af23 >2014-01-30 05:58:15,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3b46af23 >2014-01-30 05:58:15,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 45a69c37 >2014-01-30 05:58:15,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@770e9a8f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df9b6c1b}, log id: 45a69c37 >2014-01-30 05:58:15,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 425fcb29 >2014-01-30 05:58:16,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 425fcb29 >2014-01-30 05:58:16,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d8afc2c >2014-01-30 05:58:16,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d8afc2c >2014-01-30 05:58:21,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b38b238 >2014-01-30 05:58:21,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b38b238 >2014-01-30 05:58:21,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22777cb1 >2014-01-30 05:58:22,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ffa0ee2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e62005e}, log id: 22777cb1 >2014-01-30 05:58:22,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5b14314b >2014-01-30 05:58:22,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5b14314b >2014-01-30 05:58:22,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 48b0653f >2014-01-30 05:58:22,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48b0653f >2014-01-30 05:58:27,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ee949a9 >2014-01-30 05:58:28,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: ee949a9 >2014-01-30 05:58:28,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6eb10b0d >2014-01-30 05:58:28,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4602921, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df9e48be}, log id: 6eb10b0d >2014-01-30 05:58:28,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ca81db0 >2014-01-30 05:58:29,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3ca81db0 >2014-01-30 05:58:29,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 595defc5 >2014-01-30 05:58:29,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 595defc5 >2014-01-30 05:58:34,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 653dc18 >2014-01-30 05:58:34,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 653dc18 >2014-01-30 05:58:34,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 501d3ce6 >2014-01-30 05:58:35,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b1b087b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50f268de}, log id: 501d3ce6 >2014-01-30 05:58:35,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: eb9f7a5 >2014-01-30 05:58:35,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: eb9f7a5 >2014-01-30 05:58:35,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3c45d3a0 >2014-01-30 05:58:35,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c45d3a0 >2014-01-30 05:58:40,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b1d1772 >2014-01-30 05:58:41,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: b1d1772 >2014-01-30 05:58:41,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36081d08 >2014-01-30 05:58:41,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@554a8f49, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cdd4052e}, log id: 36081d08 >2014-01-30 05:58:41,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 78e80557 >2014-01-30 05:58:42,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 78e80557 >2014-01-30 05:58:42,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3c4422f6 >2014-01-30 05:58:42,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c4422f6 >2014-01-30 05:58:47,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c969c53 >2014-01-30 05:58:47,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7c969c53 >2014-01-30 05:58:47,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12d0c4dd >2014-01-30 05:58:48,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df280d11, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10f4da2b}, log id: 12d0c4dd >2014-01-30 05:58:48,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65b8ed39 >2014-01-30 05:58:48,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 65b8ed39 >2014-01-30 05:58:48,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 52ec830b >2014-01-30 05:58:49,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52ec830b >2014-01-30 05:58:50,332 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-68) No up server in cluster >2014-01-30 05:58:50,333 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-68) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:58:50,336 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-68) No up server in cluster >2014-01-30 05:58:50,336 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-68) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:58:50,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 417afeed >2014-01-30 05:58:50,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 417afeed >2014-01-30 05:58:50,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 72dc6bf5 >2014-01-30 05:58:51,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterTasksListVDSCommand, return: [], log id: 72dc6bf5 >2014-01-30 05:58:54,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5094f6a8 >2014-01-30 05:58:54,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5094f6a8 >2014-01-30 05:58:54,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53919d89 >2014-01-30 05:58:54,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2ebc30c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@721b0678}, log id: 53919d89 >2014-01-30 05:58:54,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6a20d82b >2014-01-30 05:58:55,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6a20d82b >2014-01-30 05:58:55,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6922d1f1 >2014-01-30 05:58:55,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6922d1f1 >2014-01-30 05:59:00,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2178bb60 >2014-01-30 05:59:01,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2178bb60 >2014-01-30 05:59:01,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b5ec3cc >2014-01-30 05:59:01,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b96843d5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ac59558}, log id: 2b5ec3cc >2014-01-30 05:59:01,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6803e1a2 >2014-01-30 05:59:01,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6803e1a2 >2014-01-30 05:59:01,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 434da39b >2014-01-30 05:59:02,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 434da39b >2014-01-30 05:59:07,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d619e68 >2014-01-30 05:59:07,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2d619e68 >2014-01-30 05:59:07,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e36820e >2014-01-30 05:59:08,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db4639b8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f6ed203}, log id: 4e36820e >2014-01-30 05:59:08,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 36e56361 >2014-01-30 05:59:08,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 36e56361 >2014-01-30 05:59:08,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d000251 >2014-01-30 05:59:08,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d000251 >2014-01-30 05:59:13,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f9280aa >2014-01-30 05:59:14,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6f9280aa >2014-01-30 05:59:14,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1863326e >2014-01-30 05:59:14,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70a37054, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7736486d}, log id: 1863326e >2014-01-30 05:59:14,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6921caa1 >2014-01-30 05:59:15,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6921caa1 >2014-01-30 05:59:15,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2ebc97a3 >2014-01-30 05:59:15,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ebc97a3 >2014-01-30 05:59:20,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7626d7b4 >2014-01-30 05:59:20,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7626d7b4 >2014-01-30 05:59:20,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32d74110 >2014-01-30 05:59:21,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c20b8e7d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3953b48e}, log id: 32d74110 >2014-01-30 05:59:21,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6fc438b6 >2014-01-30 05:59:21,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6fc438b6 >2014-01-30 05:59:21,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 37739516 >2014-01-30 05:59:21,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37739516 >2014-01-30 05:59:26,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17869fc7 >2014-01-30 05:59:27,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 17869fc7 >2014-01-30 05:59:27,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67b4098 >2014-01-30 05:59:27,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@153531c0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7516a77}, log id: 67b4098 >2014-01-30 05:59:27,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6a8daf54 >2014-01-30 05:59:28,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6a8daf54 >2014-01-30 05:59:28,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4c1d2a73 >2014-01-30 05:59:28,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c1d2a73 >2014-01-30 05:59:33,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4699f058 >2014-01-30 05:59:33,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4699f058 >2014-01-30 05:59:33,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 719bf6c5 >2014-01-30 05:59:34,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e79f61c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@574f35d8}, log id: 719bf6c5 >2014-01-30 05:59:34,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6dde9a1c >2014-01-30 05:59:34,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6dde9a1c >2014-01-30 05:59:34,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6da9dce4 >2014-01-30 05:59:35,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6da9dce4 >2014-01-30 05:59:40,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f93f559 >2014-01-30 05:59:40,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2f93f559 >2014-01-30 05:59:40,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5837e49e >2014-01-30 05:59:40,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da34fb9a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@200cbbc3}, log id: 5837e49e >2014-01-30 05:59:40,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 42544a8c >2014-01-30 05:59:41,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 42544a8c >2014-01-30 05:59:41,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3d8fb2ec >2014-01-30 05:59:41,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d8fb2ec >2014-01-30 05:59:46,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25497d48 >2014-01-30 05:59:47,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 25497d48 >2014-01-30 05:59:47,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16f3377c >2014-01-30 05:59:47,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6aa5caa3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9de47193}, log id: 16f3377c >2014-01-30 05:59:47,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 58a6d9ef >2014-01-30 05:59:47,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 58a6d9ef >2014-01-30 05:59:47,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e900041 >2014-01-30 05:59:48,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e900041 >2014-01-30 05:59:51,164 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-81) [5c437990] No up server in cluster >2014-01-30 05:59:51,165 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-81) [5c437990] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:59:51,168 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-81) [5c437990] No up server in cluster >2014-01-30 05:59:51,168 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-81) [5c437990] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 05:59:51,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 257dec45 >2014-01-30 05:59:51,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 257dec45 >2014-01-30 05:59:51,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 54ba79ed >2014-01-30 05:59:51,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterTasksListVDSCommand, return: [], log id: 54ba79ed >2014-01-30 05:59:53,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d3d6604 >2014-01-30 05:59:53,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5d3d6604 >2014-01-30 05:59:53,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b89c71b >2014-01-30 05:59:53,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdc99516, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ea8eefb}, log id: 7b89c71b >2014-01-30 05:59:53,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65df7615 >2014-01-30 05:59:54,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 65df7615 >2014-01-30 05:59:54,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 69bb21d4 >2014-01-30 05:59:54,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69bb21d4 >2014-01-30 05:59:59,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c50ed66 >2014-01-30 05:59:59,771 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-86) [63ec361] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 06:00:00,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4c50ed66 >2014-01-30 06:00:00,194 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-86) [63ec361] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 06:00:00,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50e8205f >2014-01-30 06:00:00,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4f13af, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ac41be1}, log id: 50e8205f >2014-01-30 06:00:00,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 59b661b1 >2014-01-30 06:00:00,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5a0a9c1 >2014-01-30 06:00:00,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4df4194a, log id: 59b661b1 >2014-01-30 06:00:00,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 54a87141 >2014-01-30 06:00:00,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5a0a9c1 >2014-01-30 06:00:00,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3bd6e053 >2014-01-30 06:00:01,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3a436c94, log id: 54a87141 >2014-01-30 06:00:01,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bd6e053 >2014-01-30 06:00:06,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a764e31 >2014-01-30 06:00:06,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3a764e31 >2014-01-30 06:00:06,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72036176 >2014-01-30 06:00:06,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9ce04bd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e0aac86}, log id: 72036176 >2014-01-30 06:00:07,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1d97958d >2014-01-30 06:00:07,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1d97958d >2014-01-30 06:00:07,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 95c7d85 >2014-01-30 06:00:07,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 95c7d85 >2014-01-30 06:00:12,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7bf4de4 >2014-01-30 06:00:13,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7bf4de4 >2014-01-30 06:00:13,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c612534 >2014-01-30 06:00:13,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9047604a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2d67828}, log id: 4c612534 >2014-01-30 06:00:13,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7db7399b >2014-01-30 06:00:14,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7db7399b >2014-01-30 06:00:14,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 67eede08 >2014-01-30 06:00:14,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67eede08 >2014-01-30 06:00:19,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ee5a5f0 >2014-01-30 06:00:19,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5ee5a5f0 >2014-01-30 06:00:19,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: bcbef33 >2014-01-30 06:00:20,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae7a6ae0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c78ab207}, log id: bcbef33 >2014-01-30 06:00:20,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 558afb39 >2014-01-30 06:00:20,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 558afb39 >2014-01-30 06:00:20,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1985ade6 >2014-01-30 06:00:20,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1985ade6 >2014-01-30 06:00:25,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 466cd901 >2014-01-30 06:00:26,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 466cd901 >2014-01-30 06:00:26,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5821d4e3 >2014-01-30 06:00:26,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa5441f6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9abdd8d}, log id: 5821d4e3 >2014-01-30 06:00:26,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6879cd3b >2014-01-30 06:00:27,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6879cd3b >2014-01-30 06:00:27,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1c4ac31e >2014-01-30 06:00:27,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c4ac31e >2014-01-30 06:00:32,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11959c5c >2014-01-30 06:00:32,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 11959c5c >2014-01-30 06:00:32,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5812a290 >2014-01-30 06:00:33,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12db4d8c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc5c8160}, log id: 5812a290 >2014-01-30 06:00:33,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 51650a7 >2014-01-30 06:00:33,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 51650a7 >2014-01-30 06:00:33,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 31b621f9 >2014-01-30 06:00:33,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31b621f9 >2014-01-30 06:00:38,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 845c913 >2014-01-30 06:00:39,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 845c913 >2014-01-30 06:00:39,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 242dda41 >2014-01-30 06:00:39,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@770c43f9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81460dc2}, log id: 242dda41 >2014-01-30 06:00:39,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4ea50ba8 >2014-01-30 06:00:40,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4ea50ba8 >2014-01-30 06:00:40,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7f50be1b >2014-01-30 06:00:40,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f50be1b >2014-01-30 06:00:45,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ffb286 >2014-01-30 06:00:45,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6ffb286 >2014-01-30 06:00:46,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b485d25 >2014-01-30 06:00:46,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a86ba395, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35cbc84b}, log id: 6b485d25 >2014-01-30 06:00:46,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ff97075 >2014-01-30 06:00:46,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6ff97075 >2014-01-30 06:00:46,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6311b91 >2014-01-30 06:00:47,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6311b91 >2014-01-30 06:00:51,990 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) [b80ce35] No up server in cluster >2014-01-30 06:00:51,990 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) [b80ce35] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:00:51,994 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) [b80ce35] No up server in cluster >2014-01-30 06:00:51,994 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) [b80ce35] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:00:52,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 324b0f89 >2014-01-30 06:00:52,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 34ab8c4f >2014-01-30 06:00:52,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 324b0f89 >2014-01-30 06:00:52,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 63e03c1f >2014-01-30 06:00:52,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 34ab8c4f >2014-01-30 06:00:52,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56d5d553 >2014-01-30 06:00:52,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterTasksListVDSCommand, return: [], log id: 63e03c1f >2014-01-30 06:00:52,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ce80f11, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cbaa345}, log id: 56d5d553 >2014-01-30 06:00:52,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5560c25e >2014-01-30 06:00:53,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5560c25e >2014-01-30 06:00:53,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5d36b798 >2014-01-30 06:00:53,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d36b798 >2014-01-30 06:00:58,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27e1a51a >2014-01-30 06:00:59,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 27e1a51a >2014-01-30 06:00:59,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31bd659 >2014-01-30 06:00:59,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f06654af, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b68fe3}, log id: 31bd659 >2014-01-30 06:00:59,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: dd8d47 >2014-01-30 06:00:59,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: dd8d47 >2014-01-30 06:00:59,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: a9e3bc4 >2014-01-30 06:01:00,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a9e3bc4 >2014-01-30 06:01:05,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 206e033d >2014-01-30 06:01:05,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 206e033d >2014-01-30 06:01:05,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fea1abe >2014-01-30 06:01:05,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@685bfa29, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55458039}, log id: 3fea1abe >2014-01-30 06:01:05,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 419afff9 >2014-01-30 06:01:06,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 419afff9 >2014-01-30 06:01:06,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1f750cab >2014-01-30 06:01:06,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f750cab >2014-01-30 06:01:11,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b620b1a >2014-01-30 06:01:12,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7b620b1a >2014-01-30 06:01:12,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ff8c1e2 >2014-01-30 06:01:12,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0d2f479, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0369a13}, log id: 6ff8c1e2 >2014-01-30 06:01:12,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7ed65ba9 >2014-01-30 06:01:12,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7ed65ba9 >2014-01-30 06:01:12,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3dba05f5 >2014-01-30 06:01:13,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3dba05f5 >2014-01-30 06:01:18,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2acc36d1 >2014-01-30 06:01:18,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2acc36d1 >2014-01-30 06:01:18,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d729d33 >2014-01-30 06:01:19,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@853a7f04, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1bda814d}, log id: 6d729d33 >2014-01-30 06:01:19,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3f3217ff >2014-01-30 06:01:19,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3f3217ff >2014-01-30 06:01:19,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 45a5f853 >2014-01-30 06:01:19,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45a5f853 >2014-01-30 06:01:24,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ae97f9 >2014-01-30 06:01:25,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4ae97f9 >2014-01-30 06:01:25,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ef28a40 >2014-01-30 06:01:25,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a035b3d6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6b94f96}, log id: 2ef28a40 >2014-01-30 06:01:25,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 42a56a0e >2014-01-30 06:01:26,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 42a56a0e >2014-01-30 06:01:26,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 19d01989 >2014-01-30 06:01:26,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19d01989 >2014-01-30 06:01:31,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5876eb7 >2014-01-30 06:01:31,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5876eb7 >2014-01-30 06:01:31,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a93bdeb >2014-01-30 06:01:32,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a198c92a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@737ad976}, log id: 4a93bdeb >2014-01-30 06:01:32,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 69167f9f >2014-01-30 06:01:32,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 69167f9f >2014-01-30 06:01:32,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4f5e0a96 >2014-01-30 06:01:32,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f5e0a96 >2014-01-30 06:01:37,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56f15b65 >2014-01-30 06:01:38,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 56f15b65 >2014-01-30 06:01:38,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 329ec78a >2014-01-30 06:01:38,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d187796, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e59379f5}, log id: 329ec78a >2014-01-30 06:01:38,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6d3fd456 >2014-01-30 06:01:39,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6d3fd456 >2014-01-30 06:01:39,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2bc7462e >2014-01-30 06:01:39,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bc7462e >2014-01-30 06:01:44,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 393c99d9 >2014-01-30 06:01:45,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 393c99d9 >2014-01-30 06:01:45,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1fafda65 >2014-01-30 06:01:45,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e04f010c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@795477cd}, log id: 1fafda65 >2014-01-30 06:01:45,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2d552317 >2014-01-30 06:01:45,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2d552317 >2014-01-30 06:01:45,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4d432725 >2014-01-30 06:01:46,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d432725 >2014-01-30 06:01:51,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11c25f2e >2014-01-30 06:01:51,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 11c25f2e >2014-01-30 06:01:51,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 608ebc1a >2014-01-30 06:01:51,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@964c963a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33a9101}, log id: 608ebc1a >2014-01-30 06:01:51,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 22e3bade >2014-01-30 06:01:52,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 22e3bade >2014-01-30 06:01:52,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 163f1974 >2014-01-30 06:01:52,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 163f1974 >2014-01-30 06:01:52,770 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] No up server in cluster >2014-01-30 06:01:52,770 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:01:52,772 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] No up server in cluster >2014-01-30 06:01:52,772 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:01:52,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65fe0ffa >2014-01-30 06:01:53,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 65fe0ffa >2014-01-30 06:01:53,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7da20473 >2014-01-30 06:01:53,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterTasksListVDSCommand, return: [], log id: 7da20473 >2014-01-30 06:01:57,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a30d6d >2014-01-30 06:01:58,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3a30d6d >2014-01-30 06:01:58,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 535151f7 >2014-01-30 06:01:58,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c78adbc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@409f12b}, log id: 535151f7 >2014-01-30 06:01:58,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6fd0ed26 >2014-01-30 06:01:58,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6fd0ed26 >2014-01-30 06:01:58,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 110e517f >2014-01-30 06:01:59,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 110e517f >2014-01-30 06:02:04,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 73026c3f >2014-01-30 06:02:04,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 73026c3f >2014-01-30 06:02:04,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 534c36ae >2014-01-30 06:02:05,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5459ba89, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2a3047f}, log id: 534c36ae >2014-01-30 06:02:05,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7829a781 >2014-01-30 06:02:05,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7829a781 >2014-01-30 06:02:05,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 415c6099 >2014-01-30 06:02:05,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 415c6099 >2014-01-30 06:02:10,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38c948dc >2014-01-30 06:02:11,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 38c948dc >2014-01-30 06:02:11,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 498eb3c8 >2014-01-30 06:02:11,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47a8a207, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72c717e7}, log id: 498eb3c8 >2014-01-30 06:02:11,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 354c215a >2014-01-30 06:02:12,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 354c215a >2014-01-30 06:02:12,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 18b17183 >2014-01-30 06:02:12,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18b17183 >2014-01-30 06:02:17,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e5b59ca >2014-01-30 06:02:17,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4e5b59ca >2014-01-30 06:02:17,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49e3be2a >2014-01-30 06:02:18,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8056a0d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f31ce1}, log id: 49e3be2a >2014-01-30 06:02:18,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 531f948e >2014-01-30 06:02:18,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 531f948e >2014-01-30 06:02:18,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 26c13085 >2014-01-30 06:02:18,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26c13085 >2014-01-30 06:02:23,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c31d9e3 >2014-01-30 06:02:24,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4c31d9e3 >2014-01-30 06:02:24,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44cafc1c >2014-01-30 06:02:24,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac57e3ee, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42e44db5}, log id: 44cafc1c >2014-01-30 06:02:24,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5d41ad86 >2014-01-30 06:02:25,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5d41ad86 >2014-01-30 06:02:25,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5e79d7e9 >2014-01-30 06:02:25,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e79d7e9 >2014-01-30 06:02:30,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68d712dd >2014-01-30 06:02:30,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 68d712dd >2014-01-30 06:02:31,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72355fe5 >2014-01-30 06:02:31,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@644711fa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ce2e040}, log id: 72355fe5 >2014-01-30 06:02:31,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ab61cf4 >2014-01-30 06:02:31,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3ab61cf4 >2014-01-30 06:02:31,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1c67a46a >2014-01-30 06:02:32,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c67a46a >2014-01-30 06:02:37,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 361feef9 >2014-01-30 06:02:37,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 361feef9 >2014-01-30 06:02:37,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44343aa >2014-01-30 06:02:37,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4bf2780, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@737d8e78}, log id: 44343aa >2014-01-30 06:02:37,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 98046e7 >2014-01-30 06:02:38,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 98046e7 >2014-01-30 06:02:38,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 70e718af >2014-01-30 06:02:38,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70e718af >2014-01-30 06:02:43,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25ab1711 >2014-01-30 06:02:44,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 25ab1711 >2014-01-30 06:02:44,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35dbf4e1 >2014-01-30 06:02:44,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa5c939f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4676ddc7}, log id: 35dbf4e1 >2014-01-30 06:02:44,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d5e971c >2014-01-30 06:02:44,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: d5e971c >2014-01-30 06:02:44,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 34102119 >2014-01-30 06:02:45,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34102119 >2014-01-30 06:02:50,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c7de49e >2014-01-30 06:02:50,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1c7de49e >2014-01-30 06:02:50,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e3260ad >2014-01-30 06:02:50,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b14f8a1c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0862952}, log id: e3260ad >2014-01-30 06:02:50,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d2a481c >2014-01-30 06:02:51,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7d2a481c >2014-01-30 06:02:51,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 37def44b >2014-01-30 06:02:51,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37def44b >2014-01-30 06:02:53,610 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-43) [871abb5] No up server in cluster >2014-01-30 06:02:53,610 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-43) [871abb5] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:02:53,613 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-43) [871abb5] No up server in cluster >2014-01-30 06:02:53,614 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-43) [871abb5] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:02:53,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 1fb91a88 >2014-01-30 06:02:54,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 1fb91a88 >2014-01-30 06:02:54,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: d764847 >2014-01-30 06:02:54,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterTasksListVDSCommand, return: [], log id: d764847 >2014-01-30 06:02:56,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4dff87d2 >2014-01-30 06:02:57,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4dff87d2 >2014-01-30 06:02:57,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a879744 >2014-01-30 06:02:57,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f62bb7d0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@575fff4}, log id: 6a879744 >2014-01-30 06:02:57,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3d488efa >2014-01-30 06:02:58,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3d488efa >2014-01-30 06:02:58,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d23e644 >2014-01-30 06:02:58,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d23e644 >2014-01-30 06:03:03,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 39dc7686 >2014-01-30 06:03:03,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 39dc7686 >2014-01-30 06:03:03,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 367251da >2014-01-30 06:03:04,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6175ce94, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24d2505f}, log id: 367251da >2014-01-30 06:03:04,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6d27d547 >2014-01-30 06:03:04,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6d27d547 >2014-01-30 06:03:04,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7cd32957 >2014-01-30 06:03:04,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cd32957 >2014-01-30 06:03:09,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 416692e >2014-01-30 06:03:10,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 416692e >2014-01-30 06:03:10,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38d05678 >2014-01-30 06:03:10,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49bf918f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dac6a115}, log id: 38d05678 >2014-01-30 06:03:10,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 364edc91 >2014-01-30 06:03:11,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 364edc91 >2014-01-30 06:03:11,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77d18389 >2014-01-30 06:03:11,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77d18389 >2014-01-30 06:03:16,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4560e292 >2014-01-30 06:03:16,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4560e292 >2014-01-30 06:03:16,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 694c1024 >2014-01-30 06:03:17,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88fb766a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34ef6329}, log id: 694c1024 >2014-01-30 06:03:17,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 718f410f >2014-01-30 06:03:17,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 718f410f >2014-01-30 06:03:17,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 57746afc >2014-01-30 06:03:18,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57746afc >2014-01-30 06:03:23,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: cf09e3b >2014-01-30 06:03:23,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: cf09e3b >2014-01-30 06:03:23,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 75d44123 >2014-01-30 06:03:23,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a17454da, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36f6b549}, log id: 75d44123 >2014-01-30 06:03:23,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6366428f >2014-01-30 06:03:24,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6366428f >2014-01-30 06:03:24,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 43266a06 >2014-01-30 06:03:24,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43266a06 >2014-01-30 06:03:29,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59f76ee4 >2014-01-30 06:03:30,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 59f76ee4 >2014-01-30 06:03:30,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58359d74 >2014-01-30 06:03:30,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b5ab52c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce320402}, log id: 58359d74 >2014-01-30 06:03:30,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4a2dac6f >2014-01-30 06:03:30,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4a2dac6f >2014-01-30 06:03:30,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 47db41a5 >2014-01-30 06:03:31,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47db41a5 >2014-01-30 06:03:36,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6370a52f >2014-01-30 06:03:36,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6370a52f >2014-01-30 06:03:36,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ff179c0 >2014-01-30 06:03:36,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92e6a0bf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7cc0100c}, log id: 5ff179c0 >2014-01-30 06:03:36,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 48237c95 >2014-01-30 06:03:37,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 48237c95 >2014-01-30 06:03:37,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 16803a88 >2014-01-30 06:03:37,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16803a88 >2014-01-30 06:03:42,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ad67b60 >2014-01-30 06:03:43,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4ad67b60 >2014-01-30 06:03:43,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c9ac2c1 >2014-01-30 06:03:43,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e24f313, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c74f3b08}, log id: 4c9ac2c1 >2014-01-30 06:03:43,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3433ceb3 >2014-01-30 06:03:44,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3433ceb3 >2014-01-30 06:03:44,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 53470623 >2014-01-30 06:03:44,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53470623 >2014-01-30 06:03:49,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3123583e >2014-01-30 06:03:49,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3123583e >2014-01-30 06:03:49,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36701336 >2014-01-30 06:03:50,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec5c64ae, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de521e06}, log id: 36701336 >2014-01-30 06:03:50,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7b1888d3 >2014-01-30 06:03:50,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7b1888d3 >2014-01-30 06:03:50,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7c25a49f >2014-01-30 06:03:50,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c25a49f >2014-01-30 06:03:54,423 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-2) [237643cb] No up server in cluster >2014-01-30 06:03:54,423 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-2) [237643cb] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:03:54,426 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-2) [237643cb] No up server in cluster >2014-01-30 06:03:54,426 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-2) [237643cb] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:03:54,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 1324f6f3 >2014-01-30 06:03:54,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 1324f6f3 >2014-01-30 06:03:55,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77f9bacf >2014-01-30 06:03:55,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterTasksListVDSCommand, return: [], log id: 77f9bacf >2014-01-30 06:03:55,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50050881 >2014-01-30 06:03:56,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 50050881 >2014-01-30 06:03:56,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e8ffd9 >2014-01-30 06:03:56,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24a42aa7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32077862}, log id: 2e8ffd9 >2014-01-30 06:03:56,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 49dfc046 >2014-01-30 06:03:57,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 49dfc046 >2014-01-30 06:03:57,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2bca9b46 >2014-01-30 06:03:57,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bca9b46 >2014-01-30 06:04:02,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1264868e >2014-01-30 06:04:02,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1264868e >2014-01-30 06:04:02,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 263deec1 >2014-01-30 06:04:03,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8342583f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@642184e3}, log id: 263deec1 >2014-01-30 06:04:03,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5fed0858 >2014-01-30 06:04:03,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5fed0858 >2014-01-30 06:04:03,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1adc5b70 >2014-01-30 06:04:03,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1adc5b70 >2014-01-30 06:04:08,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b258a79 >2014-01-30 06:04:09,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3b258a79 >2014-01-30 06:04:09,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e0ee846 >2014-01-30 06:04:09,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccf6d9fb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@904221f3}, log id: 2e0ee846 >2014-01-30 06:04:09,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2c161ff4 >2014-01-30 06:04:10,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2c161ff4 >2014-01-30 06:04:10,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 48428d5d >2014-01-30 06:04:10,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48428d5d >2014-01-30 06:04:15,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e9ccf6c >2014-01-30 06:04:16,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: e9ccf6c >2014-01-30 06:04:16,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23473cfa >2014-01-30 06:04:16,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21d05604, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e610d635}, log id: 23473cfa >2014-01-30 06:04:16,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 63ac5baf >2014-01-30 06:04:16,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 63ac5baf >2014-01-30 06:04:16,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3b678b12 >2014-01-30 06:04:17,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b678b12 >2014-01-30 06:04:22,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 159f2c31 >2014-01-30 06:04:22,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 159f2c31 >2014-01-30 06:04:22,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f1c25c4 >2014-01-30 06:04:22,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d70da67, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@696ca0db}, log id: 1f1c25c4 >2014-01-30 06:04:22,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 45d24451 >2014-01-30 06:04:23,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 45d24451 >2014-01-30 06:04:23,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7576c3a0 >2014-01-30 06:04:23,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7576c3a0 >2014-01-30 06:04:28,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2bf50f3b >2014-01-30 06:04:29,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2bf50f3b >2014-01-30 06:04:29,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11c4a5cc >2014-01-30 06:04:29,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc12bd07, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ba0fcaa}, log id: 11c4a5cc >2014-01-30 06:04:29,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ae0bff6 >2014-01-30 06:04:29,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3ae0bff6 >2014-01-30 06:04:29,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4339f965 >2014-01-30 06:04:30,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4339f965 >2014-01-30 06:04:35,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f6c6e4e >2014-01-30 06:04:35,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4f6c6e4e >2014-01-30 06:04:35,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b4d7154 >2014-01-30 06:04:35,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5bdd2e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4370d620}, log id: 3b4d7154 >2014-01-30 06:04:35,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1e75ed48 >2014-01-30 06:04:36,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1e75ed48 >2014-01-30 06:04:36,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 73664dc1 >2014-01-30 06:04:36,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73664dc1 >2014-01-30 06:04:41,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 517725b6 >2014-01-30 06:04:42,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 517725b6 >2014-01-30 06:04:42,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 310a8938 >2014-01-30 06:04:42,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8cf5a63, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fffc2d72}, log id: 310a8938 >2014-01-30 06:04:42,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2fbee2f8 >2014-01-30 06:04:42,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2fbee2f8 >2014-01-30 06:04:42,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 125801a >2014-01-30 06:04:43,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 125801a >2014-01-30 06:04:48,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7250f87c >2014-01-30 06:04:48,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7250f87c >2014-01-30 06:04:48,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 47ed7179 >2014-01-30 06:04:48,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d2654a0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce8c2809}, log id: 47ed7179 >2014-01-30 06:04:49,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6dcee730 >2014-01-30 06:04:49,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6dcee730 >2014-01-30 06:04:49,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3e7315f7 >2014-01-30 06:04:49,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e7315f7 >2014-01-30 06:04:54,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b7df91b >2014-01-30 06:04:55,271 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-29) [520212b8] No up server in cluster >2014-01-30 06:04:55,271 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-29) [520212b8] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:04:55,274 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-29) [520212b8] No up server in cluster >2014-01-30 06:04:55,274 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-29) [520212b8] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:04:55,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7b7df91b >2014-01-30 06:04:55,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 1d7dd0f7 >2014-01-30 06:04:55,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4034291f >2014-01-30 06:04:55,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@808d756a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65c334cc}, log id: 4034291f >2014-01-30 06:04:55,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6e99c50a >2014-01-30 06:04:55,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 1d7dd0f7 >2014-01-30 06:04:55,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 10f85137 >2014-01-30 06:04:56,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6e99c50a >2014-01-30 06:04:56,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 240de3c6 >2014-01-30 06:04:56,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterTasksListVDSCommand, return: [], log id: 10f85137 >2014-01-30 06:04:56,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 240de3c6 >2014-01-30 06:05:01,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 5e4c16c2 >2014-01-30 06:05:01,294 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 06:05:01,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@798c8e49, log id: 5e4c16c2 >2014-01-30 06:05:01,372 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-27) [1194a119] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 06:05:01,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ad198f6 >2014-01-30 06:05:01,554 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-27) [1194a119] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 06:05:01,578 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-27) [1194a119] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 06:05:01,578 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-27) [1194a119] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 06:05:01,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7ad198f6 >2014-01-30 06:05:01,864 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-27) [1194a119] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 06:05:01,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 61e5ca0b >2014-01-30 06:05:02,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47826060, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa227833}, log id: 61e5ca0b >2014-01-30 06:05:02,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 4943525d >2014-01-30 06:05:02,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5997b143 >2014-01-30 06:05:02,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1518a205, log id: 4943525d >2014-01-30 06:05:02,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5997b143 >2014-01-30 06:05:02,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4435b1dc >2014-01-30 06:05:02,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4435b1dc >2014-01-30 06:05:07,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 370588e8 >2014-01-30 06:05:08,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 370588e8 >2014-01-30 06:05:08,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69dfeca1 >2014-01-30 06:05:08,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39c7ac24, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ddddb57}, log id: 69dfeca1 >2014-01-30 06:05:08,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7ffd00f3 >2014-01-30 06:05:09,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7ffd00f3 >2014-01-30 06:05:09,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 290f300c >2014-01-30 06:05:09,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 290f300c >2014-01-30 06:05:14,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c12d7bd >2014-01-30 06:05:14,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4c12d7bd >2014-01-30 06:05:14,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7384460 >2014-01-30 06:05:15,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a95e3da, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e54ca5c}, log id: 7384460 >2014-01-30 06:05:15,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: be4ab76 >2014-01-30 06:05:15,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: be4ab76 >2014-01-30 06:05:15,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 381db2d0 >2014-01-30 06:05:15,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 381db2d0 >2014-01-30 06:05:21,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 517d378e >2014-01-30 06:05:21,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 517d378e >2014-01-30 06:05:21,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3072aab0 >2014-01-30 06:05:21,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@609f3381, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49351a1c}, log id: 3072aab0 >2014-01-30 06:05:21,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4b45bb12 >2014-01-30 06:05:22,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4b45bb12 >2014-01-30 06:05:22,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4c39706b >2014-01-30 06:05:22,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c39706b >2014-01-30 06:05:27,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3256fb85 >2014-01-30 06:05:28,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3256fb85 >2014-01-30 06:05:28,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54531b9 >2014-01-30 06:05:28,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18e1bf5a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e1f1c0f}, log id: 54531b9 >2014-01-30 06:05:28,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2cf7501b >2014-01-30 06:05:28,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2cf7501b >2014-01-30 06:05:28,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7dbae020 >2014-01-30 06:05:29,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7dbae020 >2014-01-30 06:05:34,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1dc5d7f7 >2014-01-30 06:05:34,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1dc5d7f7 >2014-01-30 06:05:34,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ab8b531 >2014-01-30 06:05:34,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85b74fa8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8008920}, log id: 3ab8b531 >2014-01-30 06:05:34,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 25d3723f >2014-01-30 06:05:35,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 25d3723f >2014-01-30 06:05:35,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4b196559 >2014-01-30 06:05:35,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b196559 >2014-01-30 06:05:40,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 28d14748 >2014-01-30 06:05:41,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 28d14748 >2014-01-30 06:05:41,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c6d9c8f >2014-01-30 06:05:41,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2d31b40, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca14bed8}, log id: 1c6d9c8f >2014-01-30 06:05:41,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1c33c75b >2014-01-30 06:05:41,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1c33c75b >2014-01-30 06:05:41,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 29788091 >2014-01-30 06:05:42,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29788091 >2014-01-30 06:05:47,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 709e1b2f >2014-01-30 06:05:47,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 709e1b2f >2014-01-30 06:05:47,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: faf31e >2014-01-30 06:05:47,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73d51409, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f903417f}, log id: faf31e >2014-01-30 06:05:48,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1a46b800 >2014-01-30 06:05:48,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1a46b800 >2014-01-30 06:05:48,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7ab4c28d >2014-01-30 06:05:48,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ab4c28d >2014-01-30 06:05:53,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c21a019 >2014-01-30 06:05:54,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c21a019 >2014-01-30 06:05:54,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 253aab5b >2014-01-30 06:05:54,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b982fe24, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f4a4015}, log id: 253aab5b >2014-01-30 06:05:54,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2447c072 >2014-01-30 06:05:54,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2447c072 >2014-01-30 06:05:54,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: feca910 >2014-01-30 06:05:55,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: feca910 >2014-01-30 06:05:56,068 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-58) [5c017a7a] No up server in cluster >2014-01-30 06:05:56,068 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-58) [5c017a7a] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:05:56,071 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-58) [5c017a7a] No up server in cluster >2014-01-30 06:05:56,071 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-58) [5c017a7a] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:05:56,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 64f501a3 >2014-01-30 06:05:56,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 64f501a3 >2014-01-30 06:05:56,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 233f7252 >2014-01-30 06:05:56,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterTasksListVDSCommand, return: [], log id: 233f7252 >2014-01-30 06:06:00,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f948517 >2014-01-30 06:06:00,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5f948517 >2014-01-30 06:06:00,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27f81c45 >2014-01-30 06:06:01,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7d8db3b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6057fd5}, log id: 27f81c45 >2014-01-30 06:06:01,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ead9bed >2014-01-30 06:06:01,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3ead9bed >2014-01-30 06:06:01,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 13173685 >2014-01-30 06:06:01,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13173685 >2014-01-30 06:06:06,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4670748e >2014-01-30 06:06:07,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4670748e >2014-01-30 06:06:07,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7166c30a >2014-01-30 06:06:07,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c614e89, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a8fc877}, log id: 7166c30a >2014-01-30 06:06:07,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 63ba0b81 >2014-01-30 06:06:08,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 63ba0b81 >2014-01-30 06:06:08,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ceb90a8 >2014-01-30 06:06:08,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ceb90a8 >2014-01-30 06:06:13,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6988ef4c >2014-01-30 06:06:13,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6988ef4c >2014-01-30 06:06:13,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4856a68 >2014-01-30 06:06:14,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6a603de, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb3723c3}, log id: 4856a68 >2014-01-30 06:06:14,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6d7def96 >2014-01-30 06:06:14,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6d7def96 >2014-01-30 06:06:14,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 30ec9e5 >2014-01-30 06:06:14,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 30ec9e5 >2014-01-30 06:06:19,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5aa2c45d >2014-01-30 06:06:20,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5aa2c45d >2014-01-30 06:06:20,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19f9b023 >2014-01-30 06:06:20,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d57c7c6c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b4a5517}, log id: 19f9b023 >2014-01-30 06:06:20,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3def90f0 >2014-01-30 06:06:21,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3def90f0 >2014-01-30 06:06:21,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 71db904f >2014-01-30 06:06:21,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71db904f >2014-01-30 06:06:26,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 251e1952 >2014-01-30 06:06:27,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 251e1952 >2014-01-30 06:06:27,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44bb0db0 >2014-01-30 06:06:27,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16b3c680, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4e253a2}, log id: 44bb0db0 >2014-01-30 06:06:27,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 557ad996 >2014-01-30 06:06:27,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 557ad996 >2014-01-30 06:06:27,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: f5788ae >2014-01-30 06:06:28,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f5788ae >2014-01-30 06:06:33,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e0b12d >2014-01-30 06:06:33,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e0b12d >2014-01-30 06:06:33,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1287d79e >2014-01-30 06:06:33,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c550b5c1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a812cf9}, log id: 1287d79e >2014-01-30 06:06:33,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 406dffaf >2014-01-30 06:06:34,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 406dffaf >2014-01-30 06:06:34,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: bc1074 >2014-01-30 06:06:34,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: bc1074 >2014-01-30 06:06:39,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 588c1d49 >2014-01-30 06:06:40,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 588c1d49 >2014-01-30 06:06:40,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66831c37 >2014-01-30 06:06:40,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f91e130b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10a84d8a}, log id: 66831c37 >2014-01-30 06:06:40,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3c902e81 >2014-01-30 06:06:40,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3c902e81 >2014-01-30 06:06:40,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 21662858 >2014-01-30 06:06:41,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21662858 >2014-01-30 06:06:46,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d2aa36a >2014-01-30 06:06:46,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3d2aa36a >2014-01-30 06:06:46,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8517cc0 >2014-01-30 06:06:46,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91fa084c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d310c14}, log id: 8517cc0 >2014-01-30 06:06:46,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 472cdb98 >2014-01-30 06:06:47,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 472cdb98 >2014-01-30 06:06:47,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5a710f36 >2014-01-30 06:06:47,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a710f36 >2014-01-30 06:06:52,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f5e0820 >2014-01-30 06:06:53,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7f5e0820 >2014-01-30 06:06:53,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35c0fa84 >2014-01-30 06:06:53,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e03444ac, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3aad3664}, log id: 35c0fa84 >2014-01-30 06:06:53,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 38d241c >2014-01-30 06:06:53,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 38d241c >2014-01-30 06:06:53,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 151812aa >2014-01-30 06:06:54,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 151812aa >2014-01-30 06:06:56,913 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-59) [499ce58b] No up server in cluster >2014-01-30 06:06:56,914 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-59) [499ce58b] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:06:56,917 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-59) [499ce58b] No up server in cluster >2014-01-30 06:06:56,917 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-59) [499ce58b] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:06:56,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 687f3e4c >2014-01-30 06:06:57,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 687f3e4c >2014-01-30 06:06:57,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: a9313d >2014-01-30 06:06:57,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterTasksListVDSCommand, return: [], log id: a9313d >2014-01-30 06:06:59,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35e8616 >2014-01-30 06:06:59,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 35e8616 >2014-01-30 06:06:59,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e0a0439 >2014-01-30 06:07:00,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33e4e827, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1bc90ae}, log id: 7e0a0439 >2014-01-30 06:07:00,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3096a72 >2014-01-30 06:07:00,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3096a72 >2014-01-30 06:07:00,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 415d716a >2014-01-30 06:07:00,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 415d716a >2014-01-30 06:07:05,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3864e4c8 >2014-01-30 06:07:06,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3864e4c8 >2014-01-30 06:07:06,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b29a529 >2014-01-30 06:07:06,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26687106, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32b65846}, log id: 7b29a529 >2014-01-30 06:07:06,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 68dfe2dd >2014-01-30 06:07:07,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 68dfe2dd >2014-01-30 06:07:07,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 505140d7 >2014-01-30 06:07:07,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 505140d7 >2014-01-30 06:07:12,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 460df6ef >2014-01-30 06:07:12,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 460df6ef >2014-01-30 06:07:12,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d6b7528 >2014-01-30 06:07:13,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7a06fe6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c88494b7}, log id: 5d6b7528 >2014-01-30 06:07:13,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 11d9daa6 >2014-01-30 06:07:13,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 11d9daa6 >2014-01-30 06:07:13,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 63e3da80 >2014-01-30 06:07:13,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63e3da80 >2014-01-30 06:07:18,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6667fcc >2014-01-30 06:07:19,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6667fcc >2014-01-30 06:07:19,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6acc7f0a >2014-01-30 06:07:19,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49f49c93, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ce49819}, log id: 6acc7f0a >2014-01-30 06:07:19,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 86274f5 >2014-01-30 06:07:20,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 86274f5 >2014-01-30 06:07:20,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 33f757b7 >2014-01-30 06:07:20,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33f757b7 >2014-01-30 06:07:25,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 166aa11f >2014-01-30 06:07:25,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 166aa11f >2014-01-30 06:07:25,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56e3c088 >2014-01-30 06:07:26,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f5c55a9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@534475dd}, log id: 56e3c088 >2014-01-30 06:07:26,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a610a54 >2014-01-30 06:07:26,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7a610a54 >2014-01-30 06:07:26,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 277942c6 >2014-01-30 06:07:26,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 277942c6 >2014-01-30 06:07:31,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46ad10b1 >2014-01-30 06:07:32,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 46ad10b1 >2014-01-30 06:07:32,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52dd5455 >2014-01-30 06:07:32,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4cbd1be5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5cc5a349}, log id: 52dd5455 >2014-01-30 06:07:32,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 73217760 >2014-01-30 06:07:33,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 73217760 >2014-01-30 06:07:33,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 78faeef0 >2014-01-30 06:07:33,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78faeef0 >2014-01-30 06:07:38,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1039c8e2 >2014-01-30 06:07:39,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1039c8e2 >2014-01-30 06:07:39,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76f48868 >2014-01-30 06:07:39,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@625f361d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5df9d1ef}, log id: 76f48868 >2014-01-30 06:07:39,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: f28a67 >2014-01-30 06:07:39,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: f28a67 >2014-01-30 06:07:39,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1efbf070 >2014-01-30 06:07:40,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1efbf070 >2014-01-30 06:07:45,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ed380a1 >2014-01-30 06:07:45,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: ed380a1 >2014-01-30 06:07:45,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3912be1e >2014-01-30 06:07:45,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@766211d5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd2aaaea}, log id: 3912be1e >2014-01-30 06:07:45,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7bd1dd4 >2014-01-30 06:07:46,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7bd1dd4 >2014-01-30 06:07:46,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7765050f >2014-01-30 06:07:46,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7765050f >2014-01-30 06:07:51,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72ac365a >2014-01-30 06:07:52,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 72ac365a >2014-01-30 06:07:52,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e4066be >2014-01-30 06:07:52,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2872b5fa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0e9e654}, log id: 1e4066be >2014-01-30 06:07:52,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2631172c >2014-01-30 06:07:52,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2631172c >2014-01-30 06:07:52,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6e5538cd >2014-01-30 06:07:53,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e5538cd >2014-01-30 06:07:57,726 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-84) [2ccca513] No up server in cluster >2014-01-30 06:07:57,726 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-84) [2ccca513] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:07:57,729 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-84) [2ccca513] No up server in cluster >2014-01-30 06:07:57,729 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-84) [2ccca513] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:07:57,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 7b43980 >2014-01-30 06:07:58,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e3398c7 >2014-01-30 06:07:58,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 7b43980 >2014-01-30 06:07:58,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 59d2609f >2014-01-30 06:07:58,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterTasksListVDSCommand, return: [], log id: 59d2609f >2014-01-30 06:07:58,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1e3398c7 >2014-01-30 06:07:58,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51bfe2e0 >2014-01-30 06:07:58,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@957a224b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc0b50b9}, log id: 51bfe2e0 >2014-01-30 06:07:58,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 295795f0 >2014-01-30 06:07:59,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 295795f0 >2014-01-30 06:07:59,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3a0af9 >2014-01-30 06:07:59,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a0af9 >2014-01-30 06:08:04,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40d17a9e >2014-01-30 06:08:05,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 40d17a9e >2014-01-30 06:08:05,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ea93104 >2014-01-30 06:08:05,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1fbaf12, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52b9d880}, log id: 6ea93104 >2014-01-30 06:08:05,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4be33593 >2014-01-30 06:08:06,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4be33593 >2014-01-30 06:08:06,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e47e2af >2014-01-30 06:08:06,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e47e2af >2014-01-30 06:08:11,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a649c90 >2014-01-30 06:08:11,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3a649c90 >2014-01-30 06:08:11,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12c6d08a >2014-01-30 06:08:12,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32568be2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20f1a95a}, log id: 12c6d08a >2014-01-30 06:08:12,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 31fa30c0 >2014-01-30 06:08:12,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 31fa30c0 >2014-01-30 06:08:12,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2bcf9562 >2014-01-30 06:08:12,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bcf9562 >2014-01-30 06:08:17,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1294773e >2014-01-30 06:08:18,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1294773e >2014-01-30 06:08:18,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d060a78 >2014-01-30 06:08:18,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21a63d0f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7944652}, log id: 5d060a78 >2014-01-30 06:08:18,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 413f3820 >2014-01-30 06:08:19,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 413f3820 >2014-01-30 06:08:19,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2e60c2ff >2014-01-30 06:08:19,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e60c2ff >2014-01-30 06:08:24,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b28f74b >2014-01-30 06:08:24,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7b28f74b >2014-01-30 06:08:24,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ec9990a >2014-01-30 06:08:25,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b802e4f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c95abe73}, log id: 5ec9990a >2014-01-30 06:08:25,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6115f458 >2014-01-30 06:08:25,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6115f458 >2014-01-30 06:08:25,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 568aaf06 >2014-01-30 06:08:25,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 568aaf06 >2014-01-30 06:08:30,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31795bb1 >2014-01-30 06:08:31,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 31795bb1 >2014-01-30 06:08:31,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13015ccf >2014-01-30 06:08:31,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@523d7e61, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4dcdbca}, log id: 13015ccf >2014-01-30 06:08:31,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 341199cb >2014-01-30 06:08:32,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 341199cb >2014-01-30 06:08:32,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3698357 >2014-01-30 06:08:32,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3698357 >2014-01-30 06:08:37,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21567ba1 >2014-01-30 06:08:37,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 21567ba1 >2014-01-30 06:08:37,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8219845 >2014-01-30 06:08:38,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3966e45, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f316a651}, log id: 8219845 >2014-01-30 06:08:38,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 66869124 >2014-01-30 06:08:38,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 66869124 >2014-01-30 06:08:38,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 634c0d36 >2014-01-30 06:08:39,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 634c0d36 >2014-01-30 06:08:44,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a774ce3 >2014-01-30 06:08:44,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4a774ce3 >2014-01-30 06:08:44,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 105d23d2 >2014-01-30 06:08:44,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e96d87e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a687bd1d}, log id: 105d23d2 >2014-01-30 06:08:44,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 10b85e74 >2014-01-30 06:08:45,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 10b85e74 >2014-01-30 06:08:45,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 66df0d7c >2014-01-30 06:08:45,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66df0d7c >2014-01-30 06:08:50,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79295bc4 >2014-01-30 06:08:51,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 79295bc4 >2014-01-30 06:08:51,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f9e922e >2014-01-30 06:08:51,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8f84d24, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8dfa1d95}, log id: f9e922e >2014-01-30 06:08:51,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5847744e >2014-01-30 06:08:51,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5847744e >2014-01-30 06:08:51,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5d4ddd5b >2014-01-30 06:08:52,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d4ddd5b >2014-01-30 06:08:57,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 57427986 >2014-01-30 06:08:57,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 57427986 >2014-01-30 06:08:57,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b589386 >2014-01-30 06:08:57,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3450ded7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8c2eb00}, log id: 1b589386 >2014-01-30 06:08:57,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65c01641 >2014-01-30 06:08:58,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 65c01641 >2014-01-30 06:08:58,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 72deabc5 >2014-01-30 06:08:58,556 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-92) [61402a04] No up server in cluster >2014-01-30 06:08:58,556 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-92) [61402a04] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:08:58,558 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-92) [61402a04] No up server in cluster >2014-01-30 06:08:58,558 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-92) [61402a04] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:08:58,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: b42aec7 >2014-01-30 06:08:58,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72deabc5 >2014-01-30 06:08:59,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: b42aec7 >2014-01-30 06:08:59,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 61a4ad23 >2014-01-30 06:08:59,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterTasksListVDSCommand, return: [], log id: 61a4ad23 >2014-01-30 06:09:03,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c5ecc20 >2014-01-30 06:09:04,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4c5ecc20 >2014-01-30 06:09:04,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a3be579 >2014-01-30 06:09:04,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fa72b67, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcb76107}, log id: 4a3be579 >2014-01-30 06:09:04,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 78af1d2c >2014-01-30 06:09:04,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 78af1d2c >2014-01-30 06:09:04,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1e1de7c7 >2014-01-30 06:09:05,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e1de7c7 >2014-01-30 06:09:10,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1dac15be >2014-01-30 06:09:10,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1dac15be >2014-01-30 06:09:10,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66437f7e >2014-01-30 06:09:11,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39693c87, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ad5b1f7}, log id: 66437f7e >2014-01-30 06:09:11,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 424cc022 >2014-01-30 06:09:11,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 424cc022 >2014-01-30 06:09:11,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3eed3b13 >2014-01-30 06:09:11,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3eed3b13 >2014-01-30 06:09:16,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f40c4cc >2014-01-30 06:09:17,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: f40c4cc >2014-01-30 06:09:17,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11596362 >2014-01-30 06:09:17,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf4443f6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99969f8}, log id: 11596362 >2014-01-30 06:09:17,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 10fc20d8 >2014-01-30 06:09:18,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 10fc20d8 >2014-01-30 06:09:18,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 72fd5a >2014-01-30 06:09:18,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72fd5a >2014-01-30 06:09:23,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ee111e6 >2014-01-30 06:09:23,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: ee111e6 >2014-01-30 06:09:23,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c12c7c7 >2014-01-30 06:09:24,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cebaf077, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a51a536e}, log id: 5c12c7c7 >2014-01-30 06:09:24,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 12df167f >2014-01-30 06:09:24,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 12df167f >2014-01-30 06:09:24,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5366b2e7 >2014-01-30 06:09:24,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5366b2e7 >2014-01-30 06:09:29,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32d05221 >2014-01-30 06:09:30,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 32d05221 >2014-01-30 06:09:30,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 536a8c1a >2014-01-30 06:09:30,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4396c51, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da6a8e94}, log id: 536a8c1a >2014-01-30 06:09:30,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4466c7b3 >2014-01-30 06:09:31,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4466c7b3 >2014-01-30 06:09:31,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 298b1e6e >2014-01-30 06:09:31,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 298b1e6e >2014-01-30 06:09:36,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e45802a >2014-01-30 06:09:36,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1e45802a >2014-01-30 06:09:36,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54a07c5f >2014-01-30 06:09:37,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ef02287, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd25c6d1}, log id: 54a07c5f >2014-01-30 06:09:37,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3e6216ec >2014-01-30 06:09:37,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3e6216ec >2014-01-30 06:09:37,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 457b700e >2014-01-30 06:09:37,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 457b700e >2014-01-30 06:09:42,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30fb8dcc >2014-01-30 06:09:43,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 30fb8dcc >2014-01-30 06:09:43,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7305c9df >2014-01-30 06:09:43,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22772a3c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@148eeb73}, log id: 7305c9df >2014-01-30 06:09:43,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1ae71c3c >2014-01-30 06:09:44,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1ae71c3c >2014-01-30 06:09:44,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4789c34f >2014-01-30 06:09:44,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4789c34f >2014-01-30 06:09:49,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6096962c >2014-01-30 06:09:49,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6096962c >2014-01-30 06:09:49,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c6cc7b2 >2014-01-30 06:09:50,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58813bb4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97f55b0d}, log id: 1c6cc7b2 >2014-01-30 06:09:50,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 333a7215 >2014-01-30 06:09:50,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 333a7215 >2014-01-30 06:09:50,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5ab29efb >2014-01-30 06:09:50,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ab29efb >2014-01-30 06:09:56,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ad4cd85 >2014-01-30 06:09:56,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4ad4cd85 >2014-01-30 06:09:56,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 350ef99 >2014-01-30 06:09:56,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd7f543e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25846f3e}, log id: 350ef99 >2014-01-30 06:09:56,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 258956ff >2014-01-30 06:09:57,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 258956ff >2014-01-30 06:09:57,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5a02ecc5 >2014-01-30 06:09:57,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a02ecc5 >2014-01-30 06:09:59,384 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-86) [63ec361] No up server in cluster >2014-01-30 06:09:59,384 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-86) [63ec361] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:09:59,387 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-86) [63ec361] No up server in cluster >2014-01-30 06:09:59,387 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-86) [63ec361] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:09:59,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17f91f71 >2014-01-30 06:09:59,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 17f91f71 >2014-01-30 06:09:59,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 161a502c >2014-01-30 06:10:00,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterTasksListVDSCommand, return: [], log id: 161a502c >2014-01-30 06:10:02,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 665e8e03 >2014-01-30 06:10:02,534 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-27) [1194a119] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 06:10:02,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3abbb0bd, log id: 665e8e03 >2014-01-30 06:10:02,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7850666a >2014-01-30 06:10:02,746 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-15) [13272f75] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 06:10:03,000 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-15) [13272f75] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 06:10:03,165 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-15) [13272f75] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 06:10:03,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7850666a >2014-01-30 06:10:03,249 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-15) [13272f75] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 06:10:03,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64d67a1a >2014-01-30 06:10:03,363 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-15) [13272f75] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 06:10:03,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41a804a8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c849d1aa}, log id: 64d67a1a >2014-01-30 06:10:03,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 4c6b2b45 >2014-01-30 06:10:03,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3b8aa5dc >2014-01-30 06:10:03,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7a5533ac, log id: 4c6b2b45 >2014-01-30 06:10:04,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3b8aa5dc >2014-01-30 06:10:04,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 475ddc7c >2014-01-30 06:10:04,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 475ddc7c >2014-01-30 06:10:09,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15eb2865 >2014-01-30 06:10:09,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 15eb2865 >2014-01-30 06:10:09,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d80f3cc >2014-01-30 06:10:10,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eeed44f1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2af023c0}, log id: 2d80f3cc >2014-01-30 06:10:10,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6a182087 >2014-01-30 06:10:10,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6a182087 >2014-01-30 06:10:10,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 69aff7d7 >2014-01-30 06:10:10,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69aff7d7 >2014-01-30 06:10:15,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b50ce43 >2014-01-30 06:10:16,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3b50ce43 >2014-01-30 06:10:16,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69f3eaac >2014-01-30 06:10:16,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d0226bc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e162d25}, log id: 69f3eaac >2014-01-30 06:10:16,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2ac5b3d8 >2014-01-30 06:10:17,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2ac5b3d8 >2014-01-30 06:10:17,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 33c65ce6 >2014-01-30 06:10:17,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33c65ce6 >2014-01-30 06:10:22,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a23f7c0 >2014-01-30 06:10:22,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5a23f7c0 >2014-01-30 06:10:22,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 788f93d5 >2014-01-30 06:10:23,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f75a015, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22e831af}, log id: 788f93d5 >2014-01-30 06:10:23,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 31ee43ec >2014-01-30 06:10:23,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 31ee43ec >2014-01-30 06:10:23,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 23959c16 >2014-01-30 06:10:23,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23959c16 >2014-01-30 06:10:28,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 39164205 >2014-01-30 06:10:29,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 39164205 >2014-01-30 06:10:29,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ac357c7 >2014-01-30 06:10:29,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae2843c7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adb01c7a}, log id: 4ac357c7 >2014-01-30 06:10:29,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 43f8c42c >2014-01-30 06:10:30,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 43f8c42c >2014-01-30 06:10:30,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 11c5f11e >2014-01-30 06:10:30,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11c5f11e >2014-01-30 06:10:35,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23afb48f >2014-01-30 06:10:36,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 23afb48f >2014-01-30 06:10:36,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3beffbfc >2014-01-30 06:10:36,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46f4f08d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce08a8c3}, log id: 3beffbfc >2014-01-30 06:10:36,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5bc99ab1 >2014-01-30 06:10:36,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5bc99ab1 >2014-01-30 06:10:36,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65499b2b >2014-01-30 06:10:37,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65499b2b >2014-01-30 06:10:42,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59b39e49 >2014-01-30 06:10:42,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 59b39e49 >2014-01-30 06:10:42,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ec3afc9 >2014-01-30 06:10:42,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd2685f6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@edf9415d}, log id: 2ec3afc9 >2014-01-30 06:10:42,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 389a0e8 >2014-01-30 06:10:43,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 389a0e8 >2014-01-30 06:10:43,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 58ecb301 >2014-01-30 06:10:43,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58ecb301 >2014-01-30 06:10:48,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6095b851 >2014-01-30 06:10:49,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6095b851 >2014-01-30 06:10:49,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 62a3cb85 >2014-01-30 06:10:49,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8339250, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cdb70eed}, log id: 62a3cb85 >2014-01-30 06:10:49,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3074b8cd >2014-01-30 06:10:50,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3074b8cd >2014-01-30 06:10:50,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 451f1657 >2014-01-30 06:10:50,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 451f1657 >2014-01-30 06:10:55,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b34e979 >2014-01-30 06:10:55,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b34e979 >2014-01-30 06:10:55,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e1b44a2 >2014-01-30 06:10:56,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3cda7ce, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40e09149}, log id: 3e1b44a2 >2014-01-30 06:10:56,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: a750c90 >2014-01-30 06:10:56,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: a750c90 >2014-01-30 06:10:56,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7f6d3f4f >2014-01-30 06:10:56,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f6d3f4f >2014-01-30 06:11:00,215 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] No up server in cluster >2014-01-30 06:11:00,215 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:11:00,218 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] No up server in cluster >2014-01-30 06:11:00,218 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:11:00,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 264bcd3f >2014-01-30 06:11:00,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 264bcd3f >2014-01-30 06:11:00,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 58a0689c >2014-01-30 06:11:01,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterTasksListVDSCommand, return: [], log id: 58a0689c >2014-01-30 06:11:01,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 638bdf64 >2014-01-30 06:11:02,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 638bdf64 >2014-01-30 06:11:02,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a823644 >2014-01-30 06:11:02,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f6eda73, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3671110b}, log id: 4a823644 >2014-01-30 06:11:02,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 706b5246 >2014-01-30 06:11:03,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 706b5246 >2014-01-30 06:11:03,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 257caad4 >2014-01-30 06:11:03,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 257caad4 >2014-01-30 06:11:08,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c8d21e2 >2014-01-30 06:11:08,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5c8d21e2 >2014-01-30 06:11:08,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 766c356a >2014-01-30 06:11:09,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d066b0e9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ad7eb8c}, log id: 766c356a >2014-01-30 06:11:09,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 13f15b9 >2014-01-30 06:11:09,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 13f15b9 >2014-01-30 06:11:09,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4b2fb1b1 >2014-01-30 06:11:09,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b2fb1b1 >2014-01-30 06:11:14,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4af4ebe0 >2014-01-30 06:11:15,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4af4ebe0 >2014-01-30 06:11:15,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12aeeb38 >2014-01-30 06:11:15,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee7bdee6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a149d57}, log id: 12aeeb38 >2014-01-30 06:11:15,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: bdcb8e3 >2014-01-30 06:11:16,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: bdcb8e3 >2014-01-30 06:11:16,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5847e890 >2014-01-30 06:11:16,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5847e890 >2014-01-30 06:11:21,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a70c94f >2014-01-30 06:11:22,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1a70c94f >2014-01-30 06:11:22,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b7560e2 >2014-01-30 06:11:22,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1127ad2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@749ae3a7}, log id: 5b7560e2 >2014-01-30 06:11:22,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 55edf19d >2014-01-30 06:11:22,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 55edf19d >2014-01-30 06:11:22,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4dafa49f >2014-01-30 06:11:23,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4dafa49f >2014-01-30 06:11:28,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4408c4be >2014-01-30 06:11:28,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4408c4be >2014-01-30 06:11:28,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ae30d1a >2014-01-30 06:11:28,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e63465b4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42227f10}, log id: 2ae30d1a >2014-01-30 06:11:28,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 276b0c19 >2014-01-30 06:11:29,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 276b0c19 >2014-01-30 06:11:29,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 62319833 >2014-01-30 06:11:29,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62319833 >2014-01-30 06:11:34,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1048f6d9 >2014-01-30 06:11:35,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1048f6d9 >2014-01-30 06:11:35,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 73bb41ef >2014-01-30 06:11:35,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26d43722, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d9f469a}, log id: 73bb41ef >2014-01-30 06:11:35,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 75631d23 >2014-01-30 06:11:35,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 75631d23 >2014-01-30 06:11:35,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3868df8d >2014-01-30 06:11:36,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3868df8d >2014-01-30 06:11:41,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a7544aa >2014-01-30 06:11:41,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a7544aa >2014-01-30 06:11:41,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31dddd13 >2014-01-30 06:11:41,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@892b39fc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9f5b564}, log id: 31dddd13 >2014-01-30 06:11:41,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6f62f192 >2014-01-30 06:11:42,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6f62f192 >2014-01-30 06:11:42,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 142da804 >2014-01-30 06:11:42,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 142da804 >2014-01-30 06:11:47,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31df27ee >2014-01-30 06:11:48,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 31df27ee >2014-01-30 06:11:48,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2478f8d8 >2014-01-30 06:11:48,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f83ccc3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d50aafc}, log id: 2478f8d8 >2014-01-30 06:11:48,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: c0be089 >2014-01-30 06:11:48,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: c0be089 >2014-01-30 06:11:48,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2d398b76 >2014-01-30 06:11:49,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d398b76 >2014-01-30 06:11:54,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6021919e >2014-01-30 06:11:54,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6021919e >2014-01-30 06:11:54,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 576f816f >2014-01-30 06:11:54,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e67ed5f5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d05b376}, log id: 576f816f >2014-01-30 06:11:55,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1bca927c >2014-01-30 06:11:55,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1bca927c >2014-01-30 06:11:55,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5164bedb >2014-01-30 06:11:55,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5164bedb >2014-01-30 06:12:00,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6bf4aeab >2014-01-30 06:12:01,049 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-27) [1194a119] No up server in cluster >2014-01-30 06:12:01,049 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-27) [1194a119] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:12:01,051 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-27) [1194a119] No up server in cluster >2014-01-30 06:12:01,051 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-27) [1194a119] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:12:01,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 1e2400bc >2014-01-30 06:12:01,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6bf4aeab >2014-01-30 06:12:01,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ba987ba >2014-01-30 06:12:01,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c56bd59, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89f859e5}, log id: 5ba987ba >2014-01-30 06:12:01,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c0076d9 >2014-01-30 06:12:01,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 1e2400bc >2014-01-30 06:12:01,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 662b3e3b >2014-01-30 06:12:01,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterTasksListVDSCommand, return: [], log id: 662b3e3b >2014-01-30 06:12:01,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5c0076d9 >2014-01-30 06:12:01,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: dfeca43 >2014-01-30 06:12:02,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: dfeca43 >2014-01-30 06:12:07,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19ffbb2d >2014-01-30 06:12:07,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 19ffbb2d >2014-01-30 06:12:07,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e342df3 >2014-01-30 06:12:07,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d654b7a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c942e7a}, log id: e342df3 >2014-01-30 06:12:08,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 42593cb3 >2014-01-30 06:12:08,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 42593cb3 >2014-01-30 06:12:08,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 18889b2d >2014-01-30 06:12:08,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18889b2d >2014-01-30 06:12:13,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74e825cf >2014-01-30 06:12:14,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 74e825cf >2014-01-30 06:12:14,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7299b6cf >2014-01-30 06:12:14,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8100c104, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@200f2d6}, log id: 7299b6cf >2014-01-30 06:12:14,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3c24671e >2014-01-30 06:12:15,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3c24671e >2014-01-30 06:12:15,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5df5d15d >2014-01-30 06:12:15,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5df5d15d >2014-01-30 06:12:20,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7fd60a2f >2014-01-30 06:12:20,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7fd60a2f >2014-01-30 06:12:20,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 177e85c9 >2014-01-30 06:12:21,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c4414a3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@594c0fc2}, log id: 177e85c9 >2014-01-30 06:12:21,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5ac2ff8 >2014-01-30 06:12:21,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5ac2ff8 >2014-01-30 06:12:21,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 57586346 >2014-01-30 06:12:21,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57586346 >2014-01-30 06:12:26,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52eb33bb >2014-01-30 06:12:27,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 52eb33bb >2014-01-30 06:12:27,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11039371 >2014-01-30 06:12:27,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b328933, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e4c9f08}, log id: 11039371 >2014-01-30 06:12:27,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ece9cf2 >2014-01-30 06:12:28,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6ece9cf2 >2014-01-30 06:12:28,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7f330f25 >2014-01-30 06:12:28,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f330f25 >2014-01-30 06:12:33,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5576e75e >2014-01-30 06:12:33,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5576e75e >2014-01-30 06:12:33,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b94b0a1 >2014-01-30 06:12:34,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@daed2513, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34866680}, log id: 1b94b0a1 >2014-01-30 06:12:34,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 48c6622 >2014-01-30 06:12:34,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 48c6622 >2014-01-30 06:12:34,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 445db890 >2014-01-30 06:12:34,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 445db890 >2014-01-30 06:12:39,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e1fec9b >2014-01-30 06:12:40,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3e1fec9b >2014-01-30 06:12:40,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 319e5b2 >2014-01-30 06:12:40,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d6d3a10, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e359a7c6}, log id: 319e5b2 >2014-01-30 06:12:40,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 721e73e7 >2014-01-30 06:12:41,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 721e73e7 >2014-01-30 06:12:41,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 589f0316 >2014-01-30 06:12:41,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 589f0316 >2014-01-30 06:12:46,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a312926 >2014-01-30 06:12:46,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7a312926 >2014-01-30 06:12:46,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a8bb2bf >2014-01-30 06:12:47,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5189fb8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8cc15701}, log id: 2a8bb2bf >2014-01-30 06:12:47,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4832556e >2014-01-30 06:12:47,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4832556e >2014-01-30 06:12:47,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 24094160 >2014-01-30 06:12:48,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24094160 >2014-01-30 06:12:53,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 522fcb6a >2014-01-30 06:12:53,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 522fcb6a >2014-01-30 06:12:53,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d5ff8e9 >2014-01-30 06:12:53,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5940a976, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2249004}, log id: 5d5ff8e9 >2014-01-30 06:12:53,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 8f81e53 >2014-01-30 06:12:54,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 8f81e53 >2014-01-30 06:12:54,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 8ebbf89 >2014-01-30 06:12:54,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8ebbf89 >2014-01-30 06:12:59,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53101522 >2014-01-30 06:13:00,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 53101522 >2014-01-30 06:13:00,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 485f79fd >2014-01-30 06:13:00,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8052221, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dba465b8}, log id: 485f79fd >2014-01-30 06:13:00,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5e989a69 >2014-01-30 06:13:00,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5e989a69 >2014-01-30 06:13:00,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 68ff2bd6 >2014-01-30 06:13:01,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68ff2bd6 >2014-01-30 06:13:01,778 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-74) [61851da7] No up server in cluster >2014-01-30 06:13:01,779 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-74) [61851da7] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:13:01,781 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-74) [61851da7] No up server in cluster >2014-01-30 06:13:01,781 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-74) [61851da7] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:13:01,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 59368351 >2014-01-30 06:13:02,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 59368351 >2014-01-30 06:13:02,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 79969832 >2014-01-30 06:13:02,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterTasksListVDSCommand, return: [], log id: 79969832 >2014-01-30 06:13:06,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52376255 >2014-01-30 06:13:06,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 52376255 >2014-01-30 06:13:06,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b3db0ef >2014-01-30 06:13:06,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4f3d9cb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b063ef3c}, log id: b3db0ef >2014-01-30 06:13:06,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 58e1a236 >2014-01-30 06:13:07,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 58e1a236 >2014-01-30 06:13:07,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1a124b21 >2014-01-30 06:13:07,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a124b21 >2014-01-30 06:13:12,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d57a44c >2014-01-30 06:13:13,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3d57a44c >2014-01-30 06:13:13,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6cf51dee >2014-01-30 06:13:13,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51cd1a14, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e955a169}, log id: 6cf51dee >2014-01-30 06:13:13,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 500d2733 >2014-01-30 06:13:14,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 500d2733 >2014-01-30 06:13:14,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b594bac >2014-01-30 06:13:14,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b594bac >2014-01-30 06:13:19,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e08406b >2014-01-30 06:13:19,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6e08406b >2014-01-30 06:13:19,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 116c08fc >2014-01-30 06:13:20,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c8f4c38, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7cf34b28}, log id: 116c08fc >2014-01-30 06:13:20,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5214cf14 >2014-01-30 06:13:20,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5214cf14 >2014-01-30 06:13:20,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 45071ef4 >2014-01-30 06:13:20,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45071ef4 >2014-01-30 06:13:25,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51413f33 >2014-01-30 06:13:26,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 51413f33 >2014-01-30 06:13:26,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29c0535f >2014-01-30 06:13:26,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b08e82f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ef647cb}, log id: 29c0535f >2014-01-30 06:13:26,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 58de5f5b >2014-01-30 06:13:27,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 58de5f5b >2014-01-30 06:13:27,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3c9fb015 >2014-01-30 06:13:27,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3c9fb015 >2014-01-30 06:13:32,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2fa44b60 >2014-01-30 06:13:32,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2fa44b60 >2014-01-30 06:13:32,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e307713 >2014-01-30 06:13:33,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebdf0e3c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb45fb43}, log id: 2e307713 >2014-01-30 06:13:33,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2472d96d >2014-01-30 06:13:33,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2472d96d >2014-01-30 06:13:33,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7f7b0506 >2014-01-30 06:13:34,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f7b0506 >2014-01-30 06:13:39,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 70897cda >2014-01-30 06:13:39,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 70897cda >2014-01-30 06:13:39,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c2e6667 >2014-01-30 06:13:39,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b53cf55, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e31a894}, log id: 3c2e6667 >2014-01-30 06:13:39,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2db4a1d6 >2014-01-30 06:13:40,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2db4a1d6 >2014-01-30 06:13:40,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 63ac84cb >2014-01-30 06:13:40,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63ac84cb >2014-01-30 06:13:45,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 114076cd >2014-01-30 06:13:46,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 114076cd >2014-01-30 06:13:46,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74b364bb >2014-01-30 06:13:46,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c516c30e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51672d65}, log id: 74b364bb >2014-01-30 06:13:46,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 21600fd8 >2014-01-30 06:13:46,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 21600fd8 >2014-01-30 06:13:46,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ed74519 >2014-01-30 06:13:47,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ed74519 >2014-01-30 06:13:52,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e34f72c >2014-01-30 06:13:52,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1e34f72c >2014-01-30 06:13:52,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44072874 >2014-01-30 06:13:52,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25aa976a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e70590a}, log id: 44072874 >2014-01-30 06:13:52,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3af9991d >2014-01-30 06:13:53,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3af9991d >2014-01-30 06:13:53,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 406b9b60 >2014-01-30 06:13:53,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 406b9b60 >2014-01-30 06:13:58,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43cdd887 >2014-01-30 06:13:59,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43cdd887 >2014-01-30 06:13:59,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e4876ae >2014-01-30 06:13:59,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@443969bf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f26a7a84}, log id: 7e4876ae >2014-01-30 06:13:59,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: dd13597 >2014-01-30 06:13:59,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: dd13597 >2014-01-30 06:13:59,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4d8438f6 >2014-01-30 06:14:00,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d8438f6 >2014-01-30 06:14:02,608 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) [b80ce35] No up server in cluster >2014-01-30 06:14:02,608 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) [b80ce35] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:14:02,611 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) [b80ce35] No up server in cluster >2014-01-30 06:14:02,612 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) [b80ce35] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:14:02,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 79f9a2ae >2014-01-30 06:14:03,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 79f9a2ae >2014-01-30 06:14:03,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 66fa33a0 >2014-01-30 06:14:03,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterTasksListVDSCommand, return: [], log id: 66fa33a0 >2014-01-30 06:14:05,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 553b3f8c >2014-01-30 06:14:05,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 553b3f8c >2014-01-30 06:14:05,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15230a73 >2014-01-30 06:14:05,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68fe83fc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e8628c}, log id: 15230a73 >2014-01-30 06:14:05,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 28570070 >2014-01-30 06:14:06,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 28570070 >2014-01-30 06:14:06,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 55eee55b >2014-01-30 06:14:06,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55eee55b >2014-01-30 06:14:11,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 28b0806a >2014-01-30 06:14:12,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 28b0806a >2014-01-30 06:14:12,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c14d678 >2014-01-30 06:14:12,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9c38c8a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ff67c2b}, log id: 7c14d678 >2014-01-30 06:14:12,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3878be1d >2014-01-30 06:14:13,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3878be1d >2014-01-30 06:14:13,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3f1f65f >2014-01-30 06:14:13,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f1f65f >2014-01-30 06:14:18,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a4c2aa2 >2014-01-30 06:14:18,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5a4c2aa2 >2014-01-30 06:14:18,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 585b129b >2014-01-30 06:14:19,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e764c7f8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b5afd39}, log id: 585b129b >2014-01-30 06:14:19,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 388965b2 >2014-01-30 06:14:19,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 388965b2 >2014-01-30 06:14:19,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 68ef0594 >2014-01-30 06:14:19,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68ef0594 >2014-01-30 06:14:24,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2257c3b7 >2014-01-30 06:14:25,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2257c3b7 >2014-01-30 06:14:25,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 121f9897 >2014-01-30 06:14:25,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b183e674, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e65886fb}, log id: 121f9897 >2014-01-30 06:14:25,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 51dba17f >2014-01-30 06:14:26,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 51dba17f >2014-01-30 06:14:26,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6eb231a1 >2014-01-30 06:14:26,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6eb231a1 >2014-01-30 06:14:31,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71e7b259 >2014-01-30 06:14:31,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 71e7b259 >2014-01-30 06:14:31,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 760849ea >2014-01-30 06:14:32,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@709a3837, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb6a36eb}, log id: 760849ea >2014-01-30 06:14:32,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3641248a >2014-01-30 06:14:32,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3641248a >2014-01-30 06:14:32,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 44b1f7b0 >2014-01-30 06:14:33,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44b1f7b0 >2014-01-30 06:14:38,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48598cd9 >2014-01-30 06:14:38,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 48598cd9 >2014-01-30 06:14:38,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c749f35 >2014-01-30 06:14:38,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da429d20, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92549ff3}, log id: 7c749f35 >2014-01-30 06:14:38,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 69ce139e >2014-01-30 06:14:39,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 69ce139e >2014-01-30 06:14:39,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7167885a >2014-01-30 06:14:39,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7167885a >2014-01-30 06:14:44,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: bd8ad27 >2014-01-30 06:14:45,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: bd8ad27 >2014-01-30 06:14:45,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a89a611 >2014-01-30 06:14:45,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@266cfc58, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7be88cf}, log id: 2a89a611 >2014-01-30 06:14:45,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1b6e069b >2014-01-30 06:14:45,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1b6e069b >2014-01-30 06:14:45,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 248b0485 >2014-01-30 06:14:46,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 248b0485 >2014-01-30 06:14:51,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f4a75a9 >2014-01-30 06:14:51,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f4a75a9 >2014-01-30 06:14:51,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ebf7b8c >2014-01-30 06:14:51,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46104400, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d907be4}, log id: 7ebf7b8c >2014-01-30 06:14:51,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 694497b9 >2014-01-30 06:14:52,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 694497b9 >2014-01-30 06:14:52,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1ce8c9a4 >2014-01-30 06:14:52,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ce8c9a4 >2014-01-30 06:14:57,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66312be9 >2014-01-30 06:14:58,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 66312be9 >2014-01-30 06:14:58,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41936271 >2014-01-30 06:14:58,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5d580dc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@105c2ab4}, log id: 41936271 >2014-01-30 06:14:58,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7f7fe66e >2014-01-30 06:14:58,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7f7fe66e >2014-01-30 06:14:58,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 10b64f79 >2014-01-30 06:14:59,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10b64f79 >2014-01-30 06:15:03,444 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-15) [13272f75] No up server in cluster >2014-01-30 06:15:03,444 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-15) [13272f75] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:15:03,447 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-15) [13272f75] No up server in cluster >2014-01-30 06:15:03,448 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-15) [13272f75] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:15:03,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 6fb0cd10 >2014-01-30 06:15:03,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 26fcf1d9 >2014-01-30 06:15:03,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 6fb0cd10 >2014-01-30 06:15:03,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 57de94d8 >2014-01-30 06:15:04,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@45125a75, log id: 26fcf1d9 >2014-01-30 06:15:04,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 37f0dac0 >2014-01-30 06:15:04,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterTasksListVDSCommand, return: [], log id: 57de94d8 >2014-01-30 06:15:04,250 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-45) Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 06:15:04,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1a698f48, log id: 37f0dac0 >2014-01-30 06:15:04,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 83dcd84 >2014-01-30 06:15:04,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 83dcd84 >2014-01-30 06:15:04,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a17ac2a >2014-01-30 06:15:05,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f51ef28, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4553df9}, log id: a17ac2a >2014-01-30 06:15:05,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 42e00d29 >2014-01-30 06:15:05,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 42e00d29 >2014-01-30 06:15:05,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ad6ec64 >2014-01-30 06:15:05,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ad6ec64 >2014-01-30 06:15:10,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a68226 >2014-01-30 06:15:11,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2a68226 >2014-01-30 06:15:11,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 57d65f26 >2014-01-30 06:15:11,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9112dbae, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f729569}, log id: 57d65f26 >2014-01-30 06:15:11,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 296a0944 >2014-01-30 06:15:12,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 296a0944 >2014-01-30 06:15:12,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4cc2b2b >2014-01-30 06:15:12,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4cc2b2b >2014-01-30 06:15:17,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26d751f9 >2014-01-30 06:15:18,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 26d751f9 >2014-01-30 06:15:18,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f535e1e >2014-01-30 06:15:18,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@471e21b8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27a9c559}, log id: 5f535e1e >2014-01-30 06:15:18,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1c523065 >2014-01-30 06:15:18,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1c523065 >2014-01-30 06:15:18,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6cd63b6a >2014-01-30 06:15:19,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6cd63b6a >2014-01-30 06:15:24,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44402068 >2014-01-30 06:15:24,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 44402068 >2014-01-30 06:15:24,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b187610 >2014-01-30 06:15:24,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5cf7c32, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d309298f}, log id: 6b187610 >2014-01-30 06:15:24,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5b4ec5bc >2014-01-30 06:15:25,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5b4ec5bc >2014-01-30 06:15:25,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5f62738a >2014-01-30 06:15:25,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f62738a >2014-01-30 06:15:30,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ec8f77e >2014-01-30 06:15:31,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6ec8f77e >2014-01-30 06:15:31,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f2b93a >2014-01-30 06:15:31,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6cc086e9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da2db307}, log id: 6f2b93a >2014-01-30 06:15:31,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6afe6d65 >2014-01-30 06:15:31,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6afe6d65 >2014-01-30 06:15:31,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1364ae47 >2014-01-30 06:15:32,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1364ae47 >2014-01-30 06:15:37,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2531bd9a >2014-01-30 06:15:37,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2531bd9a >2014-01-30 06:15:37,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30caa9ad >2014-01-30 06:15:37,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79786598, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90d0da21}, log id: 30caa9ad >2014-01-30 06:15:38,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5d51e24f >2014-01-30 06:15:38,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5d51e24f >2014-01-30 06:15:38,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 64000235 >2014-01-30 06:15:38,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64000235 >2014-01-30 06:15:43,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2eff181 >2014-01-30 06:15:44,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2eff181 >2014-01-30 06:15:44,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 649ffbe >2014-01-30 06:15:44,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24f14dee, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39942ed7}, log id: 649ffbe >2014-01-30 06:15:44,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ae04b1f >2014-01-30 06:15:45,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3ae04b1f >2014-01-30 06:15:45,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 71bc9dbf >2014-01-30 06:15:45,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71bc9dbf >2014-01-30 06:15:50,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ac9ba4c >2014-01-30 06:15:50,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: ac9ba4c >2014-01-30 06:15:50,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d8be254 >2014-01-30 06:15:51,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5fa856, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e30f83a5}, log id: 6d8be254 >2014-01-30 06:15:51,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: f7fbcbf >2014-01-30 06:15:51,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: f7fbcbf >2014-01-30 06:15:51,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 20185baa >2014-01-30 06:15:51,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20185baa >2014-01-30 06:15:56,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32a968f9 >2014-01-30 06:15:57,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 32a968f9 >2014-01-30 06:15:57,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10e28d4d >2014-01-30 06:15:57,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9a8b68f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3067cf6a}, log id: 10e28d4d >2014-01-30 06:15:57,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7e4bb010 >2014-01-30 06:15:58,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7e4bb010 >2014-01-30 06:15:58,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5bd067b7 >2014-01-30 06:15:58,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5bd067b7 >2014-01-30 06:16:03,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ab996bc >2014-01-30 06:16:03,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1ab996bc >2014-01-30 06:16:03,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 45a1e429 >2014-01-30 06:16:04,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34484874, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7e6cd94}, log id: 45a1e429 >2014-01-30 06:16:04,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4310a323 >2014-01-30 06:16:04,250 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-96) [444c158d] No up server in cluster >2014-01-30 06:16:04,250 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-96) [444c158d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:16:04,253 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-96) [444c158d] No up server in cluster >2014-01-30 06:16:04,253 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-96) [444c158d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:16:04,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2335a4cd >2014-01-30 06:16:04,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4310a323 >2014-01-30 06:16:04,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1f4b447f >2014-01-30 06:16:04,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 2335a4cd >2014-01-30 06:16:04,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1d941489 >2014-01-30 06:16:04,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f4b447f >2014-01-30 06:16:05,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterTasksListVDSCommand, return: [], log id: 1d941489 >2014-01-30 06:16:09,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 278c7e95 >2014-01-30 06:16:10,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 278c7e95 >2014-01-30 06:16:10,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e947c77 >2014-01-30 06:16:10,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5fae8b6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4996cc6e}, log id: 3e947c77 >2014-01-30 06:16:10,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3d1571e5 >2014-01-30 06:16:11,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3d1571e5 >2014-01-30 06:16:11,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 58070b4b >2014-01-30 06:16:11,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58070b4b >2014-01-30 06:16:16,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 718f8679 >2014-01-30 06:16:16,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 718f8679 >2014-01-30 06:16:16,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 323e16d2 >2014-01-30 06:16:17,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8f7c949, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1fc7419b}, log id: 323e16d2 >2014-01-30 06:16:17,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 32e48476 >2014-01-30 06:16:17,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 32e48476 >2014-01-30 06:16:17,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 45f75923 >2014-01-30 06:16:18,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45f75923 >2014-01-30 06:16:23,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4383a1d8 >2014-01-30 06:16:23,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4383a1d8 >2014-01-30 06:16:23,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 47026f98 >2014-01-30 06:16:23,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@921b5704, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b25a3c6}, log id: 47026f98 >2014-01-30 06:16:23,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77f97fdd >2014-01-30 06:16:24,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 77f97fdd >2014-01-30 06:16:24,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5a1d0c61 >2014-01-30 06:16:24,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a1d0c61 >2014-01-30 06:16:29,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 683a69c5 >2014-01-30 06:16:30,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 683a69c5 >2014-01-30 06:16:30,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17d55066 >2014-01-30 06:16:30,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4022d064, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37b36078}, log id: 17d55066 >2014-01-30 06:16:30,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 44d81d46 >2014-01-30 06:16:30,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 44d81d46 >2014-01-30 06:16:30,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a8c64ce >2014-01-30 06:16:31,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a8c64ce >2014-01-30 06:16:36,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1bd2403a >2014-01-30 06:16:36,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1bd2403a >2014-01-30 06:16:36,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2094aaa7 >2014-01-30 06:16:36,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7573c7a6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac85e7bf}, log id: 2094aaa7 >2014-01-30 06:16:36,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 23a137db >2014-01-30 06:16:37,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 23a137db >2014-01-30 06:16:37,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 72f6c28e >2014-01-30 06:16:37,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72f6c28e >2014-01-30 06:16:42,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35ff5c80 >2014-01-30 06:16:43,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 35ff5c80 >2014-01-30 06:16:43,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e89c960 >2014-01-30 06:16:43,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28a7e264, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3a3e3c4}, log id: 7e89c960 >2014-01-30 06:16:43,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 31e2a7e4 >2014-01-30 06:16:43,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 31e2a7e4 >2014-01-30 06:16:43,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 315488a9 >2014-01-30 06:16:44,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 315488a9 >2014-01-30 06:16:49,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 716be399 >2014-01-30 06:16:49,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 716be399 >2014-01-30 06:16:49,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fd13d27 >2014-01-30 06:16:50,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4b1d3dd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc77cdb8}, log id: 3fd13d27 >2014-01-30 06:16:50,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: e272f09 >2014-01-30 06:16:50,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: e272f09 >2014-01-30 06:16:50,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7464c4f4 >2014-01-30 06:16:50,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7464c4f4 >2014-01-30 06:16:55,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4effd21a >2014-01-30 06:16:56,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4effd21a >2014-01-30 06:16:56,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7cc519f6 >2014-01-30 06:16:56,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@baa8203f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f01c5b6}, log id: 7cc519f6 >2014-01-30 06:16:56,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 21acb32c >2014-01-30 06:16:57,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 21acb32c >2014-01-30 06:16:57,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3fcefb55 >2014-01-30 06:16:57,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3fcefb55 >2014-01-30 06:17:02,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a9789cc >2014-01-30 06:17:02,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2a9789cc >2014-01-30 06:17:02,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 318da6cc >2014-01-30 06:17:03,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72895452, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc9fbe35}, log id: 318da6cc >2014-01-30 06:17:03,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65a8fcc8 >2014-01-30 06:17:03,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 65a8fcc8 >2014-01-30 06:17:03,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1cc74791 >2014-01-30 06:17:03,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1cc74791 >2014-01-30 06:17:05,024 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-40) [4cd31087] No up server in cluster >2014-01-30 06:17:05,024 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-40) [4cd31087] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:17:05,027 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-40) [4cd31087] No up server in cluster >2014-01-30 06:17:05,027 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-40) [4cd31087] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:17:05,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 5e5cf8cf >2014-01-30 06:17:05,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 5e5cf8cf >2014-01-30 06:17:05,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 24f36e34 >2014-01-30 06:17:05,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterTasksListVDSCommand, return: [], log id: 24f36e34 >2014-01-30 06:17:08,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a0c2801 >2014-01-30 06:17:09,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7a0c2801 >2014-01-30 06:17:09,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ed8b236 >2014-01-30 06:17:09,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2d5cb49, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b29528ea}, log id: 1ed8b236 >2014-01-30 06:17:09,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 413b009d >2014-01-30 06:17:10,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 413b009d >2014-01-30 06:17:10,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3bce4717 >2014-01-30 06:17:10,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bce4717 >2014-01-30 06:17:15,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 73ae2cd6 >2014-01-30 06:17:16,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 73ae2cd6 >2014-01-30 06:17:16,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 599f7d1d >2014-01-30 06:17:16,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f01dd78, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aed3e011}, log id: 599f7d1d >2014-01-30 06:17:16,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5575cab7 >2014-01-30 06:17:16,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5575cab7 >2014-01-30 06:17:16,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6bf15b69 >2014-01-30 06:17:17,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6bf15b69 >2014-01-30 06:17:22,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4cbd81c >2014-01-30 06:17:22,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4cbd81c >2014-01-30 06:17:22,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3299145a >2014-01-30 06:17:22,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3e3d6b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@768c068b}, log id: 3299145a >2014-01-30 06:17:22,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65a9e6e5 >2014-01-30 06:17:23,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 65a9e6e5 >2014-01-30 06:17:23,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1819f186 >2014-01-30 06:17:23,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1819f186 >2014-01-30 06:17:28,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58e70644 >2014-01-30 06:17:29,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 58e70644 >2014-01-30 06:17:29,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a4231b4 >2014-01-30 06:17:29,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67b6af1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b649fcd}, log id: 7a4231b4 >2014-01-30 06:17:29,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 42c18efd >2014-01-30 06:17:30,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 42c18efd >2014-01-30 06:17:30,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 949d114 >2014-01-30 06:17:30,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 949d114 >2014-01-30 06:17:35,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d53de21 >2014-01-30 06:17:35,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7d53de21 >2014-01-30 06:17:35,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5bae3dcc >2014-01-30 06:17:36,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d440dcb3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af658492}, log id: 5bae3dcc >2014-01-30 06:17:36,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e1e623b >2014-01-30 06:17:36,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4e1e623b >2014-01-30 06:17:36,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 39ded502 >2014-01-30 06:17:36,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39ded502 >2014-01-30 06:17:41,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6cba8368 >2014-01-30 06:17:42,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6cba8368 >2014-01-30 06:17:42,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65d5bc4b >2014-01-30 06:17:42,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f0df4d0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72421e94}, log id: 65d5bc4b >2014-01-30 06:17:42,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6313beed >2014-01-30 06:17:43,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6313beed >2014-01-30 06:17:43,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: a38a571 >2014-01-30 06:17:43,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a38a571 >2014-01-30 06:17:48,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 626b4285 >2014-01-30 06:17:48,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 626b4285 >2014-01-30 06:17:48,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e771aa >2014-01-30 06:17:49,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cc55523, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af23324d}, log id: e771aa >2014-01-30 06:17:49,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: c635676 >2014-01-30 06:17:49,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: c635676 >2014-01-30 06:17:49,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 42827df2 >2014-01-30 06:17:50,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42827df2 >2014-01-30 06:17:55,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b4f1227 >2014-01-30 06:17:55,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: b4f1227 >2014-01-30 06:17:55,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6005a684 >2014-01-30 06:17:55,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4c3725b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca43c00e}, log id: 6005a684 >2014-01-30 06:17:55,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 29ccddea >2014-01-30 06:17:56,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 29ccddea >2014-01-30 06:17:56,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2f81ec47 >2014-01-30 06:17:56,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f81ec47 >2014-01-30 06:18:01,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21a108c9 >2014-01-30 06:18:02,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 21a108c9 >2014-01-30 06:18:02,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d73881c >2014-01-30 06:18:02,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49403992, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ecbc0e33}, log id: 4d73881c >2014-01-30 06:18:02,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 339be4be >2014-01-30 06:18:02,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 339be4be >2014-01-30 06:18:02,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c7cb81e >2014-01-30 06:18:03,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c7cb81e >2014-01-30 06:18:05,840 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-63) [1d6d6076] No up server in cluster >2014-01-30 06:18:05,840 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-63) [1d6d6076] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:18:05,843 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-63) [1d6d6076] No up server in cluster >2014-01-30 06:18:05,843 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-63) [1d6d6076] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:18:05,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 235fb5c2 >2014-01-30 06:18:06,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 235fb5c2 >2014-01-30 06:18:06,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 5fa76ad0 >2014-01-30 06:18:06,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterTasksListVDSCommand, return: [], log id: 5fa76ad0 >2014-01-30 06:18:08,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 39ee91f7 >2014-01-30 06:18:08,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 39ee91f7 >2014-01-30 06:18:08,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d7a56e >2014-01-30 06:18:08,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f122d802, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e49c260}, log id: 4d7a56e >2014-01-30 06:18:09,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2707448a >2014-01-30 06:18:09,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2707448a >2014-01-30 06:18:09,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d2489da >2014-01-30 06:18:09,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d2489da >2014-01-30 06:18:14,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67869515 >2014-01-30 06:18:15,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 67869515 >2014-01-30 06:18:15,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3802481c >2014-01-30 06:18:15,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9666c36d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@121f0f1}, log id: 3802481c >2014-01-30 06:18:15,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: dee3ea >2014-01-30 06:18:16,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: dee3ea >2014-01-30 06:18:16,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7528ae1 >2014-01-30 06:18:16,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7528ae1 >2014-01-30 06:18:21,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a6a9af5 >2014-01-30 06:18:21,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a6a9af5 >2014-01-30 06:18:21,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56fa34f9 >2014-01-30 06:18:22,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e88b134, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@573350d0}, log id: 56fa34f9 >2014-01-30 06:18:22,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6d7fe5d4 >2014-01-30 06:18:22,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6d7fe5d4 >2014-01-30 06:18:22,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 60dd9581 >2014-01-30 06:18:22,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60dd9581 >2014-01-30 06:18:27,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e1c2b63 >2014-01-30 06:18:28,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2e1c2b63 >2014-01-30 06:18:28,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d87c870 >2014-01-30 06:18:28,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22e02885, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3245c3cf}, log id: 4d87c870 >2014-01-30 06:18:28,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 63cd55b3 >2014-01-30 06:18:29,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 63cd55b3 >2014-01-30 06:18:29,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 73c8f1db >2014-01-30 06:18:29,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73c8f1db >2014-01-30 06:18:34,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 45eeb66f >2014-01-30 06:18:34,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 45eeb66f >2014-01-30 06:18:34,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40717238 >2014-01-30 06:18:35,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae1eec72, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55630273}, log id: 40717238 >2014-01-30 06:18:35,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 282476fb >2014-01-30 06:18:35,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 282476fb >2014-01-30 06:18:35,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5bc19f84 >2014-01-30 06:18:35,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5bc19f84 >2014-01-30 06:18:40,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44d7af78 >2014-01-30 06:18:41,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 44d7af78 >2014-01-30 06:18:41,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e13b74a >2014-01-30 06:18:41,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b0eeba8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ad45642}, log id: 7e13b74a >2014-01-30 06:18:41,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6bd3e032 >2014-01-30 06:18:42,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6bd3e032 >2014-01-30 06:18:42,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2dc84a01 >2014-01-30 06:18:42,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2dc84a01 >2014-01-30 06:18:47,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 935cf28 >2014-01-30 06:18:48,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 935cf28 >2014-01-30 06:18:48,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d42a985 >2014-01-30 06:18:48,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51f64d2f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e732c07f}, log id: 5d42a985 >2014-01-30 06:18:48,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3bb983d4 >2014-01-30 06:18:48,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3bb983d4 >2014-01-30 06:18:48,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 147ef706 >2014-01-30 06:18:49,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 147ef706 >2014-01-30 06:18:54,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c5b307f >2014-01-30 06:18:54,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1c5b307f >2014-01-30 06:18:54,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 166dede6 >2014-01-30 06:18:54,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1fe8ea7a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd2a0e51}, log id: 166dede6 >2014-01-30 06:18:54,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7e65400c >2014-01-30 06:18:55,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7e65400c >2014-01-30 06:18:55,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b488b21 >2014-01-30 06:18:55,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b488b21 >2014-01-30 06:19:00,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e30dcbd >2014-01-30 06:19:01,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7e30dcbd >2014-01-30 06:19:01,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c2ab7b6 >2014-01-30 06:19:01,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc4602e6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1894a69e}, log id: 7c2ab7b6 >2014-01-30 06:19:01,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 32bfd524 >2014-01-30 06:19:01,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 32bfd524 >2014-01-30 06:19:01,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 307bfb0a >2014-01-30 06:19:02,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 307bfb0a >2014-01-30 06:19:06,692 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-93) [24fadd7c] No up server in cluster >2014-01-30 06:19:06,692 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:19:06,695 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-93) [24fadd7c] No up server in cluster >2014-01-30 06:19:06,695 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:19:06,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 28f35da2 >2014-01-30 06:19:07,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5907d50c >2014-01-30 06:19:07,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 28f35da2 >2014-01-30 06:19:07,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 53160b04 >2014-01-30 06:19:07,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterTasksListVDSCommand, return: [], log id: 53160b04 >2014-01-30 06:19:07,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5907d50c >2014-01-30 06:19:07,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b3429f3 >2014-01-30 06:19:07,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8f444db, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ceeb8ac2}, log id: 6b3429f3 >2014-01-30 06:19:07,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7e6dbeb >2014-01-30 06:19:08,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7e6dbeb >2014-01-30 06:19:08,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 74f98b51 >2014-01-30 06:19:08,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74f98b51 >2014-01-30 06:19:13,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b1c7b3b >2014-01-30 06:19:14,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1b1c7b3b >2014-01-30 06:19:14,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 640c14d3 >2014-01-30 06:19:14,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f164c0eb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3eb72e79}, log id: 640c14d3 >2014-01-30 06:19:14,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 125c2629 >2014-01-30 06:19:15,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 125c2629 >2014-01-30 06:19:15,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 650b3fd >2014-01-30 06:19:15,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 650b3fd >2014-01-30 06:19:20,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c94a3cd >2014-01-30 06:19:20,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3c94a3cd >2014-01-30 06:19:20,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2eaa66d0 >2014-01-30 06:19:21,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a74b5855, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9546e21}, log id: 2eaa66d0 >2014-01-30 06:19:21,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1702e1d5 >2014-01-30 06:19:21,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1702e1d5 >2014-01-30 06:19:21,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 64875953 >2014-01-30 06:19:21,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64875953 >2014-01-30 06:19:26,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4af66523 >2014-01-30 06:19:27,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4af66523 >2014-01-30 06:19:27,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12c63d9b >2014-01-30 06:19:27,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f562b846, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8322796c}, log id: 12c63d9b >2014-01-30 06:19:27,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4febda89 >2014-01-30 06:19:28,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4febda89 >2014-01-30 06:19:28,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 32d28d40 >2014-01-30 06:19:28,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32d28d40 >2014-01-30 06:19:33,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71f6eabd >2014-01-30 06:19:33,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 71f6eabd >2014-01-30 06:19:33,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54a0aaf5 >2014-01-30 06:19:34,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4079285e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2f4c736}, log id: 54a0aaf5 >2014-01-30 06:19:34,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4aa24a1e >2014-01-30 06:19:34,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4aa24a1e >2014-01-30 06:19:34,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 50e14e83 >2014-01-30 06:19:35,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50e14e83 >2014-01-30 06:19:40,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72ca1d87 >2014-01-30 06:19:40,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 72ca1d87 >2014-01-30 06:19:40,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 794f062b >2014-01-30 06:19:40,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@882aa60b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc078a71}, log id: 794f062b >2014-01-30 06:19:40,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6519f01b >2014-01-30 06:19:41,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6519f01b >2014-01-30 06:19:41,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 417abdda >2014-01-30 06:19:41,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 417abdda >2014-01-30 06:19:46,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59dfc8d3 >2014-01-30 06:19:47,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 59dfc8d3 >2014-01-30 06:19:47,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6bbabf75 >2014-01-30 06:19:47,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79d208c7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@159225c}, log id: 6bbabf75 >2014-01-30 06:19:47,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1d31b1c6 >2014-01-30 06:19:47,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1d31b1c6 >2014-01-30 06:19:47,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 12aa18a8 >2014-01-30 06:19:48,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12aa18a8 >2014-01-30 06:19:53,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ffba59e >2014-01-30 06:19:53,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6ffba59e >2014-01-30 06:19:53,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31bbd69c >2014-01-30 06:19:53,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@126f8851, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da2e0f76}, log id: 31bbd69c >2014-01-30 06:19:53,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3067189e >2014-01-30 06:19:54,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3067189e >2014-01-30 06:19:54,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 135b1776 >2014-01-30 06:19:54,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 135b1776 >2014-01-30 06:19:59,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c089a2f >2014-01-30 06:20:00,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2c089a2f >2014-01-30 06:20:00,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ecc24c4 >2014-01-30 06:20:00,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc278802, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@395e2fce}, log id: 1ecc24c4 >2014-01-30 06:20:00,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 222b5ab5 >2014-01-30 06:20:01,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 222b5ab5 >2014-01-30 06:20:01,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1d1cf0f4 >2014-01-30 06:20:01,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d1cf0f4 >2014-01-30 06:20:04,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 2a2308e8 >2014-01-30 06:20:04,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@17080176, log id: 2a2308e8 >2014-01-30 06:20:04,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: e97f5ca >2014-01-30 06:20:05,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6d7601cf, log id: e97f5ca >2014-01-30 06:20:06,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2fbe5ea5 >2014-01-30 06:20:06,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2fbe5ea5 >2014-01-30 06:20:06,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f313b01 >2014-01-30 06:20:07,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac0e74a6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8199be8}, log id: 2f313b01 >2014-01-30 06:20:07,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 75e34bdd >2014-01-30 06:20:07,487 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) [4166d263] No up server in cluster >2014-01-30 06:20:07,487 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) [4166d263] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:20:07,489 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-57) [4166d263] No up server in cluster >2014-01-30 06:20:07,490 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-57) [4166d263] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:20:07,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 5cc17ff1 >2014-01-30 06:20:07,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 75e34bdd >2014-01-30 06:20:07,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4049ff79 >2014-01-30 06:20:07,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4049ff79 >2014-01-30 06:20:07,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 5cc17ff1 >2014-01-30 06:20:08,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 72eb62b3 >2014-01-30 06:20:08,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterTasksListVDSCommand, return: [], log id: 72eb62b3 >2014-01-30 06:20:12,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74fa3d37 >2014-01-30 06:20:13,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 74fa3d37 >2014-01-30 06:20:13,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c8f5296 >2014-01-30 06:20:13,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e368998, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa4cad67}, log id: 5c8f5296 >2014-01-30 06:20:13,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 423ff737 >2014-01-30 06:20:14,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 423ff737 >2014-01-30 06:20:14,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4110a89e >2014-01-30 06:20:14,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4110a89e >2014-01-30 06:20:19,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 355a0f3 >2014-01-30 06:20:19,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 355a0f3 >2014-01-30 06:20:19,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ac0f4b3 >2014-01-30 06:20:20,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@571356bb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1aa55eba}, log id: 2ac0f4b3 >2014-01-30 06:20:20,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: b452784 >2014-01-30 06:20:20,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: b452784 >2014-01-30 06:20:20,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 24270b47 >2014-01-30 06:20:21,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24270b47 >2014-01-30 06:20:26,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 28a25207 >2014-01-30 06:20:26,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 28a25207 >2014-01-30 06:20:26,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 520e458f >2014-01-30 06:20:26,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8be2eb21, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3edec043}, log id: 520e458f >2014-01-30 06:20:26,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 69f6a404 >2014-01-30 06:20:27,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 69f6a404 >2014-01-30 06:20:27,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: b5a7942 >2014-01-30 06:20:27,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b5a7942 >2014-01-30 06:20:32,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35c56a7f >2014-01-30 06:20:33,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 35c56a7f >2014-01-30 06:20:33,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14ccd3d5 >2014-01-30 06:20:33,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55f9b7cf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcc0c5fb}, log id: 14ccd3d5 >2014-01-30 06:20:33,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3574ca69 >2014-01-30 06:20:33,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3574ca69 >2014-01-30 06:20:33,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 34b98c5b >2014-01-30 06:20:34,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34b98c5b >2014-01-30 06:20:39,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 288f1c4a >2014-01-30 06:20:39,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 288f1c4a >2014-01-30 06:20:39,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 323cbddb >2014-01-30 06:20:39,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abed27b3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96650e40}, log id: 323cbddb >2014-01-30 06:20:39,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: fa23470 >2014-01-30 06:20:40,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: fa23470 >2014-01-30 06:20:40,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 72f85ac9 >2014-01-30 06:20:40,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72f85ac9 >2014-01-30 06:20:45,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33afdbd8 >2014-01-30 06:20:46,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 33afdbd8 >2014-01-30 06:20:46,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 359419d3 >2014-01-30 06:20:46,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f470380, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b7e87c2}, log id: 359419d3 >2014-01-30 06:20:46,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4ba6ddec >2014-01-30 06:20:47,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4ba6ddec >2014-01-30 06:20:47,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2ad8889 >2014-01-30 06:20:47,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ad8889 >2014-01-30 06:20:52,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52637877 >2014-01-30 06:20:52,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 52637877 >2014-01-30 06:20:52,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6721f3 >2014-01-30 06:20:53,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa1be07e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43400eba}, log id: 6721f3 >2014-01-30 06:20:53,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: f392e1c >2014-01-30 06:20:53,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: f392e1c >2014-01-30 06:20:53,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 57841945 >2014-01-30 06:20:53,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57841945 >2014-01-30 06:20:58,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 149e1e1a >2014-01-30 06:20:59,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 149e1e1a >2014-01-30 06:20:59,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 240fc11b >2014-01-30 06:20:59,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b43911c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b40edee3}, log id: 240fc11b >2014-01-30 06:20:59,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1446c573 >2014-01-30 06:21:00,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1446c573 >2014-01-30 06:21:00,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 68eff036 >2014-01-30 06:21:00,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68eff036 >2014-01-30 06:21:05,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e184ad7 >2014-01-30 06:21:05,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2e184ad7 >2014-01-30 06:21:05,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36a01a55 >2014-01-30 06:21:06,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8020a0f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f92e97d}, log id: 36a01a55 >2014-01-30 06:21:06,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5b80e573 >2014-01-30 06:21:06,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5b80e573 >2014-01-30 06:21:06,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4127f2d8 >2014-01-30 06:21:06,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4127f2d8 >2014-01-30 06:21:08,271 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-16) [2c713cf8] No up server in cluster >2014-01-30 06:21:08,271 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-16) [2c713cf8] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:21:08,275 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-16) [2c713cf8] No up server in cluster >2014-01-30 06:21:08,275 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-16) [2c713cf8] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:21:08,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 6a21d2fb >2014-01-30 06:21:08,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 6a21d2fb >2014-01-30 06:21:08,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 290b170e >2014-01-30 06:21:09,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterTasksListVDSCommand, return: [], log id: 290b170e >2014-01-30 06:21:11,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6772b0ae >2014-01-30 06:21:12,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6772b0ae >2014-01-30 06:21:12,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ccfb71c >2014-01-30 06:21:12,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@145bd74e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5324791d}, log id: 1ccfb71c >2014-01-30 06:21:12,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6564ded2 >2014-01-30 06:21:13,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6564ded2 >2014-01-30 06:21:13,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 901985e >2014-01-30 06:21:13,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 901985e >2014-01-30 06:21:18,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 953e2be >2014-01-30 06:21:18,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 953e2be >2014-01-30 06:21:18,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d1191c1 >2014-01-30 06:21:19,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2b8312d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@256545ed}, log id: 6d1191c1 >2014-01-30 06:21:19,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 11bdcd19 >2014-01-30 06:21:19,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 11bdcd19 >2014-01-30 06:21:19,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 51d7fbac >2014-01-30 06:21:19,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51d7fbac >2014-01-30 06:21:24,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f9da5ae >2014-01-30 06:21:25,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6f9da5ae >2014-01-30 06:21:25,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 365fa474 >2014-01-30 06:21:25,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3acff10f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@facf0c13}, log id: 365fa474 >2014-01-30 06:21:25,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1c8d2100 >2014-01-30 06:21:26,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1c8d2100 >2014-01-30 06:21:26,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 9a6b776 >2014-01-30 06:21:26,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9a6b776 >2014-01-30 06:21:31,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20fc86ff >2014-01-30 06:21:32,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 20fc86ff >2014-01-30 06:21:32,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d6c05da >2014-01-30 06:21:32,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19cb16c7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f020eed}, log id: 6d6c05da >2014-01-30 06:21:32,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7c9a66b6 >2014-01-30 06:21:32,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7c9a66b6 >2014-01-30 06:21:32,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3f1548db >2014-01-30 06:21:33,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f1548db >2014-01-30 06:21:38,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 151c39a8 >2014-01-30 06:21:38,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 151c39a8 >2014-01-30 06:21:38,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19edb418 >2014-01-30 06:21:38,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dda0bfae, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4810f7bb}, log id: 19edb418 >2014-01-30 06:21:38,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 137d56cb >2014-01-30 06:21:39,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 137d56cb >2014-01-30 06:21:39,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1f9258d1 >2014-01-30 06:21:39,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f9258d1 >2014-01-30 06:21:44,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a3b382 >2014-01-30 06:21:45,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4a3b382 >2014-01-30 06:21:45,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27c7392f >2014-01-30 06:21:45,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e75301, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcf5e9ed}, log id: 27c7392f >2014-01-30 06:21:45,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 74457806 >2014-01-30 06:21:45,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 74457806 >2014-01-30 06:21:45,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1556c787 >2014-01-30 06:21:46,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1556c787 >2014-01-30 06:21:51,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a832851 >2014-01-30 06:21:51,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5a832851 >2014-01-30 06:21:51,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 729a1065 >2014-01-30 06:21:51,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eeb53f1e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af265cee}, log id: 729a1065 >2014-01-30 06:21:52,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 8ebade7 >2014-01-30 06:21:52,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 8ebade7 >2014-01-30 06:21:52,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1a782306 >2014-01-30 06:21:52,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a782306 >2014-01-30 06:21:57,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53e30411 >2014-01-30 06:21:58,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 53e30411 >2014-01-30 06:21:58,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ae219a6 >2014-01-30 06:21:58,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e55bacfd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99ae4dc8}, log id: 6ae219a6 >2014-01-30 06:21:58,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4d3d266e >2014-01-30 06:21:59,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4d3d266e >2014-01-30 06:21:59,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 774ea91f >2014-01-30 06:21:59,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 774ea91f >2014-01-30 06:22:04,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56109311 >2014-01-30 06:22:04,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 56109311 >2014-01-30 06:22:04,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50d86546 >2014-01-30 06:22:05,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d09d9c7f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0809402}, log id: 50d86546 >2014-01-30 06:22:05,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1bddb3e8 >2014-01-30 06:22:05,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1bddb3e8 >2014-01-30 06:22:05,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: b2a8f08 >2014-01-30 06:22:05,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b2a8f08 >2014-01-30 06:22:09,084 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] No up server in cluster >2014-01-30 06:22:09,084 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:22:09,087 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] No up server in cluster >2014-01-30 06:22:09,087 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:22:09,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 258014ae >2014-01-30 06:22:09,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 258014ae >2014-01-30 06:22:09,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6cead955 >2014-01-30 06:22:09,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterTasksListVDSCommand, return: [], log id: 6cead955 >2014-01-30 06:22:10,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1112e662 >2014-01-30 06:22:11,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1112e662 >2014-01-30 06:22:11,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77423769 >2014-01-30 06:22:11,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5c75bca, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93ca35cd}, log id: 77423769 >2014-01-30 06:22:11,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7bf20601 >2014-01-30 06:22:12,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7bf20601 >2014-01-30 06:22:12,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 518aad2b >2014-01-30 06:22:12,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 518aad2b >2014-01-30 06:22:17,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b0e9430 >2014-01-30 06:22:17,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3b0e9430 >2014-01-30 06:22:17,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c99b9bb >2014-01-30 06:22:18,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@500dbb67, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9e4196}, log id: 5c99b9bb >2014-01-30 06:22:18,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 383fc271 >2014-01-30 06:22:18,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 383fc271 >2014-01-30 06:22:18,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 692e97ee >2014-01-30 06:22:19,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 692e97ee >2014-01-30 06:22:24,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58723942 >2014-01-30 06:22:24,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 58723942 >2014-01-30 06:22:24,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ae8a5aa >2014-01-30 06:22:24,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29122acc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea73e3f8}, log id: 1ae8a5aa >2014-01-30 06:22:24,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2015b04c >2014-01-30 06:22:25,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2015b04c >2014-01-30 06:22:25,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5ff47da0 >2014-01-30 06:22:25,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ff47da0 >2014-01-30 06:22:30,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6951a09e >2014-01-30 06:22:31,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6951a09e >2014-01-30 06:22:31,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7173f740 >2014-01-30 06:22:31,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3eddac4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa3b4ce4}, log id: 7173f740 >2014-01-30 06:22:31,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c926311 >2014-01-30 06:22:31,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5c926311 >2014-01-30 06:22:31,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 385d9235 >2014-01-30 06:22:32,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 385d9235 >2014-01-30 06:22:37,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1df1f786 >2014-01-30 06:22:37,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1df1f786 >2014-01-30 06:22:37,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22741a2f >2014-01-30 06:22:37,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4f90c8e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8528a5cd}, log id: 22741a2f >2014-01-30 06:22:38,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6906c19b >2014-01-30 06:22:38,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6906c19b >2014-01-30 06:22:38,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 38a5233b >2014-01-30 06:22:38,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38a5233b >2014-01-30 06:22:43,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 70bbadd7 >2014-01-30 06:22:44,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 70bbadd7 >2014-01-30 06:22:44,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d9fcfcb >2014-01-30 06:22:44,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@662c3d8a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28a326a1}, log id: 3d9fcfcb >2014-01-30 06:22:44,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 50d469ba >2014-01-30 06:22:45,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 50d469ba >2014-01-30 06:22:45,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 53559351 >2014-01-30 06:22:45,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53559351 >2014-01-30 06:22:50,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 138e90ae >2014-01-30 06:22:50,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 138e90ae >2014-01-30 06:22:50,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d517cc2 >2014-01-30 06:22:51,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a52e6f5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c7ef43b}, log id: 7d517cc2 >2014-01-30 06:22:51,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6651203e >2014-01-30 06:22:51,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6651203e >2014-01-30 06:22:51,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2909e90b >2014-01-30 06:22:51,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2909e90b >2014-01-30 06:22:56,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b4b6589 >2014-01-30 06:22:57,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b4b6589 >2014-01-30 06:22:57,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 705fe484 >2014-01-30 06:22:57,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dde0f551, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a2f76ca}, log id: 705fe484 >2014-01-30 06:22:57,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 10ea9100 >2014-01-30 06:22:58,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 10ea9100 >2014-01-30 06:22:58,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1b85ed98 >2014-01-30 06:22:58,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b85ed98 >2014-01-30 06:23:03,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4529d188 >2014-01-30 06:23:03,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4529d188 >2014-01-30 06:23:03,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 180c7b5f >2014-01-30 06:23:04,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@926f49a8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1b87e6a}, log id: 180c7b5f >2014-01-30 06:23:04,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e3f1022 >2014-01-30 06:23:04,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4e3f1022 >2014-01-30 06:23:04,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 722346a7 >2014-01-30 06:23:04,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 722346a7 >2014-01-30 06:23:09,933 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2014-01-30 06:23:09,933 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:23:09,936 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2014-01-30 06:23:09,937 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:23:09,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 446d17e5 >2014-01-30 06:23:09,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9bc5320 >2014-01-30 06:23:10,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 9bc5320 >2014-01-30 06:23:10,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 446d17e5 >2014-01-30 06:23:10,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ac4a40b >2014-01-30 06:23:10,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 46c82988 >2014-01-30 06:23:10,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterTasksListVDSCommand, return: [], log id: 46c82988 >2014-01-30 06:23:10,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@508a6fe1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a844365}, log id: ac4a40b >2014-01-30 06:23:10,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 67d2cebf >2014-01-30 06:23:11,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 67d2cebf >2014-01-30 06:23:11,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 9f88baa >2014-01-30 06:23:11,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9f88baa >2014-01-30 06:23:16,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ed399f3 >2014-01-30 06:23:17,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7ed399f3 >2014-01-30 06:23:17,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d667cc >2014-01-30 06:23:17,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1b6530, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de23416c}, log id: 5d667cc >2014-01-30 06:23:17,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5110dcc5 >2014-01-30 06:23:17,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5110dcc5 >2014-01-30 06:23:17,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 587290a2 >2014-01-30 06:23:18,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 587290a2 >2014-01-30 06:23:23,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64dd007a >2014-01-30 06:23:23,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 64dd007a >2014-01-30 06:23:23,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a0781fb >2014-01-30 06:23:23,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6591c498, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3abacca}, log id: 7a0781fb >2014-01-30 06:23:23,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 221f6d42 >2014-01-30 06:23:24,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 221f6d42 >2014-01-30 06:23:24,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d55d5d7 >2014-01-30 06:23:24,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d55d5d7 >2014-01-30 06:23:29,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ba50d93 >2014-01-30 06:23:30,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3ba50d93 >2014-01-30 06:23:30,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74024a9 >2014-01-30 06:23:30,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0f0ef35, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fdd98a80}, log id: 74024a9 >2014-01-30 06:23:30,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4d514bd8 >2014-01-30 06:23:30,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4d514bd8 >2014-01-30 06:23:31,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 28f36a70 >2014-01-30 06:23:31,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28f36a70 >2014-01-30 06:23:36,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 62606b47 >2014-01-30 06:23:36,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 62606b47 >2014-01-30 06:23:36,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30c132c0 >2014-01-30 06:23:37,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9f29b97, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f491b94}, log id: 30c132c0 >2014-01-30 06:23:37,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 271dd2ec >2014-01-30 06:23:37,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 271dd2ec >2014-01-30 06:23:37,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1d8e5075 >2014-01-30 06:23:37,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d8e5075 >2014-01-30 06:23:42,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 454a0e49 >2014-01-30 06:23:43,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 454a0e49 >2014-01-30 06:23:43,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23a91136 >2014-01-30 06:23:43,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47b96995, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aed4a27c}, log id: 23a91136 >2014-01-30 06:23:43,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4016c3f6 >2014-01-30 06:23:44,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4016c3f6 >2014-01-30 06:23:44,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 623d7ec0 >2014-01-30 06:23:44,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 623d7ec0 >2014-01-30 06:23:49,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7756f463 >2014-01-30 06:23:49,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7756f463 >2014-01-30 06:23:49,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d99eb72 >2014-01-30 06:23:50,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1f2ea52, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd6a4e4a}, log id: 2d99eb72 >2014-01-30 06:23:50,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 52bbe47d >2014-01-30 06:23:50,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 52bbe47d >2014-01-30 06:23:50,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: b070ca0 >2014-01-30 06:23:50,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b070ca0 >2014-01-30 06:23:55,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 179bd5de >2014-01-30 06:23:56,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 179bd5de >2014-01-30 06:23:56,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67055f2f >2014-01-30 06:23:56,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aad83996, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8b84328}, log id: 67055f2f >2014-01-30 06:23:56,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 109af1b1 >2014-01-30 06:23:57,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 109af1b1 >2014-01-30 06:23:57,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 44451fc5 >2014-01-30 06:23:57,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44451fc5 >2014-01-30 06:24:02,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c1abdf5 >2014-01-30 06:24:02,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2c1abdf5 >2014-01-30 06:24:02,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22f4e13f >2014-01-30 06:24:03,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd9717f8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a327ac4d}, log id: 22f4e13f >2014-01-30 06:24:03,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7fc71052 >2014-01-30 06:24:03,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7fc71052 >2014-01-30 06:24:03,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1517fd2f >2014-01-30 06:24:03,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1517fd2f >2014-01-30 06:24:09,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9bf3288 >2014-01-30 06:24:09,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 9bf3288 >2014-01-30 06:24:09,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d8d76e1 >2014-01-30 06:24:09,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0cc9e56, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c82c7d44}, log id: 6d8d76e1 >2014-01-30 06:24:09,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 221a9e93 >2014-01-30 06:24:10,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 221a9e93 >2014-01-30 06:24:10,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4a0296e8 >2014-01-30 06:24:10,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a0296e8 >2014-01-30 06:24:10,750 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-34) [4af86af0] No up server in cluster >2014-01-30 06:24:10,750 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-34) [4af86af0] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:24:10,753 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-34) [4af86af0] No up server in cluster >2014-01-30 06:24:10,753 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-34) [4af86af0] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:24:10,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f9bb295 >2014-01-30 06:24:11,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: f9bb295 >2014-01-30 06:24:11,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c81b21b >2014-01-30 06:24:11,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterTasksListVDSCommand, return: [], log id: 5c81b21b >2014-01-30 06:24:15,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25b7462b >2014-01-30 06:24:16,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 25b7462b >2014-01-30 06:24:16,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b511977 >2014-01-30 06:24:16,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66bf268a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6b02b13}, log id: 5b511977 >2014-01-30 06:24:16,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 23dfef84 >2014-01-30 06:24:16,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 23dfef84 >2014-01-30 06:24:16,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 712b310f >2014-01-30 06:24:17,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 712b310f >2014-01-30 06:24:22,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: eb036b >2014-01-30 06:24:22,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: eb036b >2014-01-30 06:24:22,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 775de9f7 >2014-01-30 06:24:22,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae08b814, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a884937}, log id: 775de9f7 >2014-01-30 06:24:22,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 9496926 >2014-01-30 06:24:23,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 9496926 >2014-01-30 06:24:23,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5f8132a8 >2014-01-30 06:24:23,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f8132a8 >2014-01-30 06:24:28,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f2c988c >2014-01-30 06:24:29,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6f2c988c >2014-01-30 06:24:29,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4892317e >2014-01-30 06:24:29,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2aa3e94d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b81ee73}, log id: 4892317e >2014-01-30 06:24:29,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1b0543e4 >2014-01-30 06:24:29,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1b0543e4 >2014-01-30 06:24:30,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 63c58c7 >2014-01-30 06:24:30,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63c58c7 >2014-01-30 06:24:35,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: fcb07b1 >2014-01-30 06:24:35,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: fcb07b1 >2014-01-30 06:24:35,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9415784 >2014-01-30 06:24:36,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d42b6d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bce98f4c}, log id: 9415784 >2014-01-30 06:24:36,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 280aa2df >2014-01-30 06:24:36,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 280aa2df >2014-01-30 06:24:36,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 472e701c >2014-01-30 06:24:36,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 472e701c >2014-01-30 06:24:41,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e61dee >2014-01-30 06:24:42,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4e61dee >2014-01-30 06:24:42,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c0554bb >2014-01-30 06:24:42,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@653fcc75, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a6ba3c4}, log id: c0554bb >2014-01-30 06:24:42,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d44e6ce >2014-01-30 06:24:43,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7d44e6ce >2014-01-30 06:24:43,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 54633707 >2014-01-30 06:24:43,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54633707 >2014-01-30 06:24:48,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1caa43bb >2014-01-30 06:24:48,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1caa43bb >2014-01-30 06:24:48,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38fcf9e5 >2014-01-30 06:24:49,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24b1bd26, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9787d7e}, log id: 38fcf9e5 >2014-01-30 06:24:49,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 709bbee6 >2014-01-30 06:24:49,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 709bbee6 >2014-01-30 06:24:49,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 9cb04ca >2014-01-30 06:24:49,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9cb04ca >2014-01-30 06:24:54,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 119539cf >2014-01-30 06:24:55,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 119539cf >2014-01-30 06:24:55,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: bbdd70e >2014-01-30 06:24:55,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@863549eb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e615e13}, log id: bbdd70e >2014-01-30 06:24:55,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6fb52c2c >2014-01-30 06:24:56,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6fb52c2c >2014-01-30 06:24:56,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 16c88c2f >2014-01-30 06:24:56,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16c88c2f >2014-01-30 06:25:01,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7478cbd >2014-01-30 06:25:01,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7478cbd >2014-01-30 06:25:01,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40ec26cb >2014-01-30 06:25:02,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c63e783a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75dc2b0a}, log id: 40ec26cb >2014-01-30 06:25:02,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1348235d >2014-01-30 06:25:02,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1348235d >2014-01-30 06:25:02,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1999306d >2014-01-30 06:25:02,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1999306d >2014-01-30 06:25:05,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 490922b8 >2014-01-30 06:25:05,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4a897abe, log id: 490922b8 >2014-01-30 06:25:05,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d9762d >2014-01-30 06:25:05,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7967df17, log id: 7d9762d >2014-01-30 06:25:07,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41a3b316 >2014-01-30 06:25:08,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 41a3b316 >2014-01-30 06:25:08,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 75aea6cb >2014-01-30 06:25:08,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a75404b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@191fe350}, log id: 75aea6cb >2014-01-30 06:25:08,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 563ddf31 >2014-01-30 06:25:09,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 563ddf31 >2014-01-30 06:25:09,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 73277270 >2014-01-30 06:25:09,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73277270 >2014-01-30 06:25:11,567 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2014-01-30 06:25:11,567 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:25:11,570 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2014-01-30 06:25:11,571 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:25:11,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 1f39dd26 >2014-01-30 06:25:12,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 1f39dd26 >2014-01-30 06:25:12,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 79d3c75e >2014-01-30 06:25:12,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [], log id: 79d3c75e >2014-01-30 06:25:14,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 573c736e >2014-01-30 06:25:14,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 573c736e >2014-01-30 06:25:14,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1776733d >2014-01-30 06:25:15,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2581fd62, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5988805b}, log id: 1776733d >2014-01-30 06:25:15,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 703fe7f0 >2014-01-30 06:25:15,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 703fe7f0 >2014-01-30 06:25:15,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5beeee0a >2014-01-30 06:25:16,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5beeee0a >2014-01-30 06:25:21,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d3e1a5e >2014-01-30 06:25:21,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3d3e1a5e >2014-01-30 06:25:21,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7747518f >2014-01-30 06:25:21,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1c2d0db, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65e1ca01}, log id: 7747518f >2014-01-30 06:25:21,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: b66b11a >2014-01-30 06:25:22,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: b66b11a >2014-01-30 06:25:22,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3cb0e676 >2014-01-30 06:25:22,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cb0e676 >2014-01-30 06:25:27,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a417f2c >2014-01-30 06:25:28,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a417f2c >2014-01-30 06:25:28,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31088150 >2014-01-30 06:25:28,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@270f36b3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4be04708}, log id: 31088150 >2014-01-30 06:25:28,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 60bfbdbd >2014-01-30 06:25:28,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 60bfbdbd >2014-01-30 06:25:28,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3320166 >2014-01-30 06:25:29,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3320166 >2014-01-30 06:25:34,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 240daa43 >2014-01-30 06:25:34,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 240daa43 >2014-01-30 06:25:34,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 631e9228 >2014-01-30 06:25:34,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d695d014, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7da9b5c}, log id: 631e9228 >2014-01-30 06:25:34,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 13639f0a >2014-01-30 06:25:35,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 13639f0a >2014-01-30 06:25:35,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7dfa7427 >2014-01-30 06:25:35,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7dfa7427 >2014-01-30 06:25:40,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e0f75e7 >2014-01-30 06:25:41,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: e0f75e7 >2014-01-30 06:25:41,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e68f2fc >2014-01-30 06:25:41,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a2bd700, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5c724f7}, log id: 4e68f2fc >2014-01-30 06:25:41,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7489153f >2014-01-30 06:25:41,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7489153f >2014-01-30 06:25:41,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 58299bf1 >2014-01-30 06:25:42,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58299bf1 >2014-01-30 06:25:47,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ae1faf3 >2014-01-30 06:25:47,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4ae1faf3 >2014-01-30 06:25:47,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5bc410af >2014-01-30 06:25:48,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebdf4628, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@178f7f1b}, log id: 5bc410af >2014-01-30 06:25:48,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 456b0ec9 >2014-01-30 06:25:48,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 456b0ec9 >2014-01-30 06:25:48,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 366b9286 >2014-01-30 06:25:48,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 366b9286 >2014-01-30 06:25:53,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44671226 >2014-01-30 06:25:54,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 44671226 >2014-01-30 06:25:54,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d8f4f3e >2014-01-30 06:25:54,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2018376, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30c1ebdb}, log id: 7d8f4f3e >2014-01-30 06:25:54,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5daf6dab >2014-01-30 06:25:55,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5daf6dab >2014-01-30 06:25:55,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 61e262df >2014-01-30 06:25:55,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61e262df >2014-01-30 06:26:00,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b18379d >2014-01-30 06:26:00,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1b18379d >2014-01-30 06:26:00,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60716a5d >2014-01-30 06:26:01,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eed27a27, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74758a1d}, log id: 60716a5d >2014-01-30 06:26:01,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 57e319dc >2014-01-30 06:26:01,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 57e319dc >2014-01-30 06:26:01,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 54141eb7 >2014-01-30 06:26:01,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54141eb7 >2014-01-30 06:26:06,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17d98ae8 >2014-01-30 06:26:07,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 17d98ae8 >2014-01-30 06:26:07,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32fac17f >2014-01-30 06:26:07,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11e14749, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87b1a26c}, log id: 32fac17f >2014-01-30 06:26:07,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d2b2d7d >2014-01-30 06:26:08,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7d2b2d7d >2014-01-30 06:26:08,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5a09de6b >2014-01-30 06:26:08,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a09de6b >2014-01-30 06:26:12,399 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-81) [5c437990] No up server in cluster >2014-01-30 06:26:12,399 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-81) [5c437990] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:26:12,401 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-81) [5c437990] No up server in cluster >2014-01-30 06:26:12,401 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-81) [5c437990] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:26:12,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14ae3fae >2014-01-30 06:26:12,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 14ae3fae >2014-01-30 06:26:12,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 61e1b168 >2014-01-30 06:26:13,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterTasksListVDSCommand, return: [], log id: 61e1b168 >2014-01-30 06:26:13,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 667539b0 >2014-01-30 06:26:13,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 667539b0 >2014-01-30 06:26:13,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 121d7000 >2014-01-30 06:26:14,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae544f06, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e41d219}, log id: 121d7000 >2014-01-30 06:26:14,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6efe2e29 >2014-01-30 06:26:14,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6efe2e29 >2014-01-30 06:26:14,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 642f0ea5 >2014-01-30 06:26:14,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 642f0ea5 >2014-01-30 06:26:20,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f856e34 >2014-01-30 06:26:20,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6f856e34 >2014-01-30 06:26:20,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6bcdf1a8 >2014-01-30 06:26:20,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f22b0ee3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4411d466}, log id: 6bcdf1a8 >2014-01-30 06:26:20,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 471d6668 >2014-01-30 06:26:21,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 471d6668 >2014-01-30 06:26:21,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 57195ed9 >2014-01-30 06:26:21,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57195ed9 >2014-01-30 06:26:26,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b5282fd >2014-01-30 06:26:27,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b5282fd >2014-01-30 06:26:27,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: abdf60b >2014-01-30 06:26:27,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46425ba1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e17e7a9}, log id: abdf60b >2014-01-30 06:26:27,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7ec3f6dc >2014-01-30 06:26:27,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7ec3f6dc >2014-01-30 06:26:27,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1fa3af1f >2014-01-30 06:26:28,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fa3af1f >2014-01-30 06:26:33,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5103ad07 >2014-01-30 06:26:33,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5103ad07 >2014-01-30 06:26:33,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 728c5196 >2014-01-30 06:26:33,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d50488f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6267aabd}, log id: 728c5196 >2014-01-30 06:26:33,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ffb46f7 >2014-01-30 06:26:34,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: ffb46f7 >2014-01-30 06:26:34,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2dd92f9e >2014-01-30 06:26:34,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2dd92f9e >2014-01-30 06:26:39,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5575a0c9 >2014-01-30 06:26:40,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5575a0c9 >2014-01-30 06:26:40,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15304429 >2014-01-30 06:26:40,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4162f78, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e6a3021}, log id: 15304429 >2014-01-30 06:26:40,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 25ea8fc9 >2014-01-30 06:26:40,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 25ea8fc9 >2014-01-30 06:26:40,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 35ee59d4 >2014-01-30 06:26:41,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35ee59d4 >2014-01-30 06:26:46,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 243bde54 >2014-01-30 06:26:46,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 243bde54 >2014-01-30 06:26:46,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e9caba6 >2014-01-30 06:26:47,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9dd20902, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7ad6fd4}, log id: 3e9caba6 >2014-01-30 06:26:47,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 43efd9a3 >2014-01-30 06:26:47,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 43efd9a3 >2014-01-30 06:26:47,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 794497ef >2014-01-30 06:26:47,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 794497ef >2014-01-30 06:26:52,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c88ddb5 >2014-01-30 06:26:53,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7c88ddb5 >2014-01-30 06:26:53,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c7fad3b >2014-01-30 06:26:53,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21569d79, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc582912}, log id: 1c7fad3b >2014-01-30 06:26:53,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3d0c115f >2014-01-30 06:26:54,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3d0c115f >2014-01-30 06:26:54,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: fd2273d >2014-01-30 06:26:54,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fd2273d >2014-01-30 06:26:59,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 113792a3 >2014-01-30 06:26:59,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 113792a3 >2014-01-30 06:26:59,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b722ebe >2014-01-30 06:27:00,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2858c075, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5b084ef}, log id: 7b722ebe >2014-01-30 06:27:00,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7742ad5d >2014-01-30 06:27:00,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7742ad5d >2014-01-30 06:27:00,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ca857ce >2014-01-30 06:27:00,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ca857ce >2014-01-30 06:27:05,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 722f34f9 >2014-01-30 06:27:06,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 722f34f9 >2014-01-30 06:27:06,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 670215f6 >2014-01-30 06:27:06,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcb54cfe, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9d13c3d}, log id: 670215f6 >2014-01-30 06:27:06,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4b529bfe >2014-01-30 06:27:07,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4b529bfe >2014-01-30 06:27:07,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4b2b2dfd >2014-01-30 06:27:07,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b2b2dfd >2014-01-30 06:27:12,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c979009 >2014-01-30 06:27:12,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1c979009 >2014-01-30 06:27:12,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 153e4e37 >2014-01-30 06:27:13,221 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-93) [24fadd7c] No up server in cluster >2014-01-30 06:27:13,221 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:27:13,223 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-93) [24fadd7c] No up server in cluster >2014-01-30 06:27:13,223 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:27:13,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 6d90a34e >2014-01-30 06:27:13,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12369439, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e410c9d2}, log id: 153e4e37 >2014-01-30 06:27:13,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 25056d3e >2014-01-30 06:27:13,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 25056d3e >2014-01-30 06:27:13,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6d9a7e35 >2014-01-30 06:27:13,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 6d90a34e >2014-01-30 06:27:13,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 58d8b1ef >2014-01-30 06:27:13,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d9a7e35 >2014-01-30 06:27:13,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterTasksListVDSCommand, return: [], log id: 58d8b1ef >2014-01-30 06:27:18,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e923be2 >2014-01-30 06:27:19,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3e923be2 >2014-01-30 06:27:19,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3703e74c >2014-01-30 06:27:19,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@190c15aa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee41b8b3}, log id: 3703e74c >2014-01-30 06:27:19,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 249ada26 >2014-01-30 06:27:20,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 249ada26 >2014-01-30 06:27:20,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5480fd2f >2014-01-30 06:27:20,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5480fd2f >2014-01-30 06:27:25,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 62b3c3ca >2014-01-30 06:27:26,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 62b3c3ca >2014-01-30 06:27:26,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c993d11 >2014-01-30 06:27:26,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cc09b1a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc7e83b4}, log id: c993d11 >2014-01-30 06:27:26,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 66f327a1 >2014-01-30 06:27:26,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 66f327a1 >2014-01-30 06:27:26,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 69e3cefc >2014-01-30 06:27:27,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69e3cefc >2014-01-30 06:27:32,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d54deab >2014-01-30 06:27:32,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2d54deab >2014-01-30 06:27:32,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7652987a >2014-01-30 06:27:32,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed040992, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8f24760}, log id: 7652987a >2014-01-30 06:27:32,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 18b7635b >2014-01-30 06:27:33,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 18b7635b >2014-01-30 06:27:33,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 571c7889 >2014-01-30 06:27:33,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 571c7889 >2014-01-30 06:27:38,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4bc8d117 >2014-01-30 06:27:39,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4bc8d117 >2014-01-30 06:27:39,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f0c7182 >2014-01-30 06:27:39,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@288b3832, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d617d33f}, log id: 1f0c7182 >2014-01-30 06:27:39,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6343f9e8 >2014-01-30 06:27:39,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6343f9e8 >2014-01-30 06:27:39,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7493d5a3 >2014-01-30 06:27:40,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7493d5a3 >2014-01-30 06:27:45,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d43d053 >2014-01-30 06:27:45,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4d43d053 >2014-01-30 06:27:45,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7afd4a82 >2014-01-30 06:27:45,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fec2c71d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b842ce94}, log id: 7afd4a82 >2014-01-30 06:27:45,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4f09758d >2014-01-30 06:27:46,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4f09758d >2014-01-30 06:27:46,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c8532bd >2014-01-30 06:27:46,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c8532bd >2014-01-30 06:27:51,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30bdb32f >2014-01-30 06:27:52,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 30bdb32f >2014-01-30 06:27:52,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1940acc3 >2014-01-30 06:27:52,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aee73eb0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b264942e}, log id: 1940acc3 >2014-01-30 06:27:52,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7b3fbefe >2014-01-30 06:27:52,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7b3fbefe >2014-01-30 06:27:52,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 59cbc890 >2014-01-30 06:27:53,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59cbc890 >2014-01-30 06:27:58,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 710f6852 >2014-01-30 06:27:58,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 710f6852 >2014-01-30 06:27:58,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f4b1c5c >2014-01-30 06:27:59,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fd830ec, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bcd6f34}, log id: 6f4b1c5c >2014-01-30 06:27:59,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b378d72 >2014-01-30 06:27:59,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2b378d72 >2014-01-30 06:27:59,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5b507318 >2014-01-30 06:27:59,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b507318 >2014-01-30 06:28:04,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79bfcca9 >2014-01-30 06:28:05,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 79bfcca9 >2014-01-30 06:28:05,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c03f74 >2014-01-30 06:28:05,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1bb408c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ceb2e61}, log id: 3c03f74 >2014-01-30 06:28:05,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1ebd2500 >2014-01-30 06:28:06,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1ebd2500 >2014-01-30 06:28:06,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4335cc6 >2014-01-30 06:28:06,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4335cc6 >2014-01-30 06:28:11,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 265fcc8a >2014-01-30 06:28:11,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 265fcc8a >2014-01-30 06:28:11,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e8fd764 >2014-01-30 06:28:12,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a08b846f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef3832c9}, log id: 6e8fd764 >2014-01-30 06:28:12,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 775315b5 >2014-01-30 06:28:12,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 775315b5 >2014-01-30 06:28:12,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4000ed0e >2014-01-30 06:28:12,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4000ed0e >2014-01-30 06:28:14,003 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-19) [7a87389a] No up server in cluster >2014-01-30 06:28:14,003 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-19) [7a87389a] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:28:14,007 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-19) [7a87389a] No up server in cluster >2014-01-30 06:28:14,007 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-19) [7a87389a] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:28:14,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 761922ae >2014-01-30 06:28:14,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 761922ae >2014-01-30 06:28:14,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 6f2b5ec5 >2014-01-30 06:28:14,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterTasksListVDSCommand, return: [], log id: 6f2b5ec5 >2014-01-30 06:28:17,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52ca8344 >2014-01-30 06:28:18,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 52ca8344 >2014-01-30 06:28:18,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 664767f9 >2014-01-30 06:28:18,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0550afb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccb51781}, log id: 664767f9 >2014-01-30 06:28:18,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4b42df0e >2014-01-30 06:28:19,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4b42df0e >2014-01-30 06:28:19,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2fd5ee63 >2014-01-30 06:28:19,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2fd5ee63 >2014-01-30 06:28:24,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 645b0737 >2014-01-30 06:28:24,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 645b0737 >2014-01-30 06:28:24,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c9ae90b >2014-01-30 06:28:25,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@afcc4174, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@271517f0}, log id: 1c9ae90b >2014-01-30 06:28:25,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 79f7114b >2014-01-30 06:28:25,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 79f7114b >2014-01-30 06:28:25,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ea15a4a >2014-01-30 06:28:25,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ea15a4a >2014-01-30 06:28:30,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2320279c >2014-01-30 06:28:31,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2320279c >2014-01-30 06:28:31,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 511fc6e5 >2014-01-30 06:28:31,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a56be44, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f83b1395}, log id: 511fc6e5 >2014-01-30 06:28:31,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 33de4c55 >2014-01-30 06:28:32,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 33de4c55 >2014-01-30 06:28:32,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 49fb9188 >2014-01-30 06:28:32,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49fb9188 >2014-01-30 06:28:37,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 92ce793 >2014-01-30 06:28:37,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 92ce793 >2014-01-30 06:28:37,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2203c5fd >2014-01-30 06:28:38,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5ee921, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@677fe64d}, log id: 2203c5fd >2014-01-30 06:28:38,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 79864bce >2014-01-30 06:28:38,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 79864bce >2014-01-30 06:28:38,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2504ac17 >2014-01-30 06:28:38,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2504ac17 >2014-01-30 06:28:44,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 159575ad >2014-01-30 06:28:44,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 159575ad >2014-01-30 06:28:44,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d178a0a >2014-01-30 06:28:44,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42f18087, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@198260f2}, log id: 2d178a0a >2014-01-30 06:28:44,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 63714ad2 >2014-01-30 06:28:45,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 63714ad2 >2014-01-30 06:28:45,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e23cf87 >2014-01-30 06:28:45,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e23cf87 >2014-01-30 06:28:50,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 492d4a1d >2014-01-30 06:28:51,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 492d4a1d >2014-01-30 06:28:51,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7bb47d7f >2014-01-30 06:28:51,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@199bff3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e51800ce}, log id: 7bb47d7f >2014-01-30 06:28:51,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e254f53 >2014-01-30 06:28:51,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4e254f53 >2014-01-30 06:28:51,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: aeea06e >2014-01-30 06:28:52,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: aeea06e >2014-01-30 06:28:57,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37fb95b2 >2014-01-30 06:28:57,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 37fb95b2 >2014-01-30 06:28:57,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30e2080d >2014-01-30 06:28:57,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1486da8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c955017}, log id: 30e2080d >2014-01-30 06:28:57,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 181a668a >2014-01-30 06:28:58,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 181a668a >2014-01-30 06:28:58,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4c02103d >2014-01-30 06:28:58,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c02103d >2014-01-30 06:29:03,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b4a9149 >2014-01-30 06:29:04,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6b4a9149 >2014-01-30 06:29:04,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 722f060d >2014-01-30 06:29:04,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc2c8de, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec6f86ad}, log id: 722f060d >2014-01-30 06:29:04,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b2a76ae >2014-01-30 06:29:04,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2b2a76ae >2014-01-30 06:29:04,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 57b66fed >2014-01-30 06:29:05,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57b66fed >2014-01-30 06:29:10,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ef3ecb >2014-01-30 06:29:10,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3ef3ecb >2014-01-30 06:29:10,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4789321a >2014-01-30 06:29:11,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3084e6b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a231e8a1}, log id: 4789321a >2014-01-30 06:29:11,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4deaa3fe >2014-01-30 06:29:11,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4deaa3fe >2014-01-30 06:29:11,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 11f598f6 >2014-01-30 06:29:11,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11f598f6 >2014-01-30 06:29:14,861 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) [992a9f] No up server in cluster >2014-01-30 06:29:14,861 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) [992a9f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:29:14,864 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-80) [992a9f] No up server in cluster >2014-01-30 06:29:14,864 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-80) [992a9f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:29:14,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 4070b66b >2014-01-30 06:29:15,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4070b66b >2014-01-30 06:29:15,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 23a26a2f >2014-01-30 06:29:15,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterTasksListVDSCommand, return: [], log id: 23a26a2f >2014-01-30 06:29:16,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e0c0832 >2014-01-30 06:29:17,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e0c0832 >2014-01-30 06:29:17,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35a35bd1 >2014-01-30 06:29:17,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6628bce1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5030fef1}, log id: 35a35bd1 >2014-01-30 06:29:17,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 69a39c29 >2014-01-30 06:29:18,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 69a39c29 >2014-01-30 06:29:18,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 641123b6 >2014-01-30 06:29:18,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 641123b6 >2014-01-30 06:29:23,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2811128e >2014-01-30 06:29:23,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2811128e >2014-01-30 06:29:23,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1be086f3 >2014-01-30 06:29:24,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4465d21, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6550fadf}, log id: 1be086f3 >2014-01-30 06:29:24,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1f05ff73 >2014-01-30 06:29:24,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1f05ff73 >2014-01-30 06:29:24,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2476f5ce >2014-01-30 06:29:24,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2476f5ce >2014-01-30 06:29:29,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b738d99 >2014-01-30 06:29:30,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6b738d99 >2014-01-30 06:29:30,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19d32f61 >2014-01-30 06:29:30,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c36d5c8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f487ea8}, log id: 19d32f61 >2014-01-30 06:29:30,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: bb353fe >2014-01-30 06:29:31,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: bb353fe >2014-01-30 06:29:31,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 211e5db1 >2014-01-30 06:29:31,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 211e5db1 >2014-01-30 06:29:36,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c1cbd1c >2014-01-30 06:29:36,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2c1cbd1c >2014-01-30 06:29:37,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23cd2cf1 >2014-01-30 06:29:37,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cdae505e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66654801}, log id: 23cd2cf1 >2014-01-30 06:29:37,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 329d0b88 >2014-01-30 06:29:37,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 329d0b88 >2014-01-30 06:29:37,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 43db1465 >2014-01-30 06:29:38,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43db1465 >2014-01-30 06:29:43,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d82c997 >2014-01-30 06:29:43,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3d82c997 >2014-01-30 06:29:43,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c156d6d >2014-01-30 06:29:43,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7cfac9f0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb42972f}, log id: 3c156d6d >2014-01-30 06:29:43,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3669dd11 >2014-01-30 06:29:44,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3669dd11 >2014-01-30 06:29:44,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 24c0f3ae >2014-01-30 06:29:44,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24c0f3ae >2014-01-30 06:29:49,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7fa55645 >2014-01-30 06:29:50,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7fa55645 >2014-01-30 06:29:50,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f560900 >2014-01-30 06:29:50,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc1687b2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f374557}, log id: 3f560900 >2014-01-30 06:29:50,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 28e7987d >2014-01-30 06:29:50,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 28e7987d >2014-01-30 06:29:50,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 16486a05 >2014-01-30 06:29:51,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16486a05 >2014-01-30 06:29:56,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1864f2b7 >2014-01-30 06:29:56,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1864f2b7 >2014-01-30 06:29:56,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b8cc0a1 >2014-01-30 06:29:57,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f440b681, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1aa44b41}, log id: 5b8cc0a1 >2014-01-30 06:29:57,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a964de7 >2014-01-30 06:29:57,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7a964de7 >2014-01-30 06:29:57,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1a17c654 >2014-01-30 06:29:57,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a17c654 >2014-01-30 06:30:02,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 677c128d >2014-01-30 06:30:03,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 677c128d >2014-01-30 06:30:03,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 39fcc086 >2014-01-30 06:30:03,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92eaf496, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42fa59a9}, log id: 39fcc086 >2014-01-30 06:30:03,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7bb16a52 >2014-01-30 06:30:04,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7bb16a52 >2014-01-30 06:30:04,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 282bb2fb >2014-01-30 06:30:04,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 282bb2fb >2014-01-30 06:30:05,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 268d5afe >2014-01-30 06:30:05,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@54b0c8f4, log id: 268d5afe >2014-01-30 06:30:05,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 2259369c >2014-01-30 06:30:06,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@5d0fc4bb, log id: 2259369c >2014-01-30 06:30:09,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 376afe20 >2014-01-30 06:30:09,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 376afe20 >2014-01-30 06:30:09,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66075e3e >2014-01-30 06:30:10,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fd0fa57, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c9a6085}, log id: 66075e3e >2014-01-30 06:30:10,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1753accd >2014-01-30 06:30:10,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1753accd >2014-01-30 06:30:10,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 41aabb28 >2014-01-30 06:30:10,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41aabb28 >2014-01-30 06:30:15,702 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-98) [e73a3c6] No up server in cluster >2014-01-30 06:30:15,702 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-98) [e73a3c6] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:30:15,705 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-98) [e73a3c6] No up server in cluster >2014-01-30 06:30:15,705 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-98) [e73a3c6] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:30:15,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 7ff05694 >2014-01-30 06:30:15,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f749c94 >2014-01-30 06:30:16,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 7ff05694 >2014-01-30 06:30:16,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 313bc27a >2014-01-30 06:30:16,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7f749c94 >2014-01-30 06:30:16,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42215c9a >2014-01-30 06:30:16,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterTasksListVDSCommand, return: [], log id: 313bc27a >2014-01-30 06:30:16,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@385beb4e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e171ce7}, log id: 42215c9a >2014-01-30 06:30:16,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3dc094f2 >2014-01-30 06:30:17,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3dc094f2 >2014-01-30 06:30:17,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 433a286d >2014-01-30 06:30:17,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 433a286d >2014-01-30 06:30:22,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e6fc891 >2014-01-30 06:30:22,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3e6fc891 >2014-01-30 06:30:22,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5476431 >2014-01-30 06:30:23,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90c535b7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eff30b81}, log id: 5476431 >2014-01-30 06:30:23,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 488ce465 >2014-01-30 06:30:23,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 488ce465 >2014-01-30 06:30:23,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7f8b52e8 >2014-01-30 06:30:23,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f8b52e8 >2014-01-30 06:30:28,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23078eca >2014-01-30 06:30:29,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 23078eca >2014-01-30 06:30:29,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2dccd38a >2014-01-30 06:30:29,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69fe9de5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@583962ca}, log id: 2dccd38a >2014-01-30 06:30:29,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4216ee2f >2014-01-30 06:30:30,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4216ee2f >2014-01-30 06:30:30,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 60f50fd7 >2014-01-30 06:30:30,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60f50fd7 >2014-01-30 06:30:35,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 695ca06a >2014-01-30 06:30:35,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 695ca06a >2014-01-30 06:30:36,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 351559c1 >2014-01-30 06:30:36,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58f324dd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e4d6473}, log id: 351559c1 >2014-01-30 06:30:36,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5342f58c >2014-01-30 06:30:36,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5342f58c >2014-01-30 06:30:36,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 66cd6c24 >2014-01-30 06:30:37,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66cd6c24 >2014-01-30 06:30:42,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e458c8b >2014-01-30 06:30:42,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7e458c8b >2014-01-30 06:30:42,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 61fc654a >2014-01-30 06:30:42,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ee004b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91f831da}, log id: 61fc654a >2014-01-30 06:30:42,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1583ed48 >2014-01-30 06:30:43,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1583ed48 >2014-01-30 06:30:43,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 169fb702 >2014-01-30 06:30:43,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 169fb702 >2014-01-30 06:30:48,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c96b931 >2014-01-30 06:30:49,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1c96b931 >2014-01-30 06:30:49,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 244a9ada >2014-01-30 06:30:49,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24fe3b03, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fe0f43b}, log id: 244a9ada >2014-01-30 06:30:49,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 581a9f45 >2014-01-30 06:30:49,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 581a9f45 >2014-01-30 06:30:49,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6aeec2a5 >2014-01-30 06:30:50,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6aeec2a5 >2014-01-30 06:30:55,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1bb43ab9 >2014-01-30 06:30:55,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1bb43ab9 >2014-01-30 06:30:55,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 224f90cd >2014-01-30 06:30:55,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21aa8bd6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29bb5b70}, log id: 224f90cd >2014-01-30 06:30:55,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4152fa12 >2014-01-30 06:30:56,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4152fa12 >2014-01-30 06:30:56,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 40745869 >2014-01-30 06:30:56,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40745869 >2014-01-30 06:31:01,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 83e0a3a >2014-01-30 06:31:02,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 83e0a3a >2014-01-30 06:31:02,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40dc00f4 >2014-01-30 06:31:02,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7be7952, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6163c1dc}, log id: 40dc00f4 >2014-01-30 06:31:02,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65a37108 >2014-01-30 06:31:02,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 65a37108 >2014-01-30 06:31:02,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 590e95a9 >2014-01-30 06:31:03,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 590e95a9 >2014-01-30 06:31:08,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 887ef4b >2014-01-30 06:31:08,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 887ef4b >2014-01-30 06:31:08,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c1dfa85 >2014-01-30 06:31:09,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86c26e7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@737bc796}, log id: 2c1dfa85 >2014-01-30 06:31:09,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 55955dfb >2014-01-30 06:31:09,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 55955dfb >2014-01-30 06:31:09,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 10d05060 >2014-01-30 06:31:09,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10d05060 >2014-01-30 06:31:14,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2dbe345f >2014-01-30 06:31:15,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2dbe345f >2014-01-30 06:31:15,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c2a6a10 >2014-01-30 06:31:15,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@afad75ba, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cac9e406}, log id: 7c2a6a10 >2014-01-30 06:31:15,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 59ac08a7 >2014-01-30 06:31:16,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 59ac08a7 >2014-01-30 06:31:16,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 402335a4 >2014-01-30 06:31:16,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 402335a4 >2014-01-30 06:31:16,467 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2014-01-30 06:31:16,467 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:31:16,470 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2014-01-30 06:31:16,471 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:31:16,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 5e872724 >2014-01-30 06:31:17,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 5e872724 >2014-01-30 06:31:17,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 5993be8 >2014-01-30 06:31:17,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5993be8 >2014-01-30 06:31:21,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4414f889 >2014-01-30 06:31:21,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4414f889 >2014-01-30 06:31:21,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32ab8db9 >2014-01-30 06:31:22,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79682fef, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15b4fa8e}, log id: 32ab8db9 >2014-01-30 06:31:22,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1197b8f8 >2014-01-30 06:31:22,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1197b8f8 >2014-01-30 06:31:22,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d81b8b >2014-01-30 06:31:22,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d81b8b >2014-01-30 06:31:27,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 216eee54 >2014-01-30 06:31:28,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 216eee54 >2014-01-30 06:31:28,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ce868da >2014-01-30 06:31:28,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1397f30d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3f87ed5}, log id: 3ce868da >2014-01-30 06:31:28,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 304fcf58 >2014-01-30 06:31:29,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 304fcf58 >2014-01-30 06:31:29,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 37d48f >2014-01-30 06:31:29,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37d48f >2014-01-30 06:31:34,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ba427e7 >2014-01-30 06:31:35,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7ba427e7 >2014-01-30 06:31:35,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5209ffcc >2014-01-30 06:31:35,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9993d2b7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb704795}, log id: 5209ffcc >2014-01-30 06:31:35,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3775eae8 >2014-01-30 06:31:35,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3775eae8 >2014-01-30 06:31:35,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3dab19ea >2014-01-30 06:31:36,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3dab19ea >2014-01-30 06:31:41,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 503506cc >2014-01-30 06:31:41,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 503506cc >2014-01-30 06:31:41,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23030fb3 >2014-01-30 06:31:41,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27443abb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebe0694a}, log id: 23030fb3 >2014-01-30 06:31:41,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 15c8d0c5 >2014-01-30 06:31:42,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 15c8d0c5 >2014-01-30 06:31:42,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 8f5f6ec >2014-01-30 06:31:42,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8f5f6ec >2014-01-30 06:31:47,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27ca890e >2014-01-30 06:31:48,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 27ca890e >2014-01-30 06:31:48,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b9f5685 >2014-01-30 06:31:48,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@add4f3e5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd0b5407}, log id: b9f5685 >2014-01-30 06:31:48,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 651c9227 >2014-01-30 06:31:48,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 651c9227 >2014-01-30 06:31:48,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7dfd786a >2014-01-30 06:31:49,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7dfd786a >2014-01-30 06:31:54,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 288be350 >2014-01-30 06:31:54,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 288be350 >2014-01-30 06:31:54,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22e0024 >2014-01-30 06:31:54,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fa32f33, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c2cdc1}, log id: 22e0024 >2014-01-30 06:31:54,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 67608b90 >2014-01-30 06:31:55,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 67608b90 >2014-01-30 06:31:55,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7c0647c0 >2014-01-30 06:31:55,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c0647c0 >2014-01-30 06:32:00,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 669fc3d2 >2014-01-30 06:32:01,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 669fc3d2 >2014-01-30 06:32:01,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ceb6b2e >2014-01-30 06:32:01,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@803fba99, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a03f91a4}, log id: 4ceb6b2e >2014-01-30 06:32:01,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1b2db37b >2014-01-30 06:32:01,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1b2db37b >2014-01-30 06:32:01,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4be1690a >2014-01-30 06:32:02,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4be1690a >2014-01-30 06:32:07,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 374cce12 >2014-01-30 06:32:07,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 374cce12 >2014-01-30 06:32:07,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 61ff7a09 >2014-01-30 06:32:08,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@385f0944, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@812bcdbb}, log id: 61ff7a09 >2014-01-30 06:32:08,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 35dd6f16 >2014-01-30 06:32:08,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 35dd6f16 >2014-01-30 06:32:08,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 62738d12 >2014-01-30 06:32:08,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62738d12 >2014-01-30 06:32:13,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 697abeb3 >2014-01-30 06:32:14,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 697abeb3 >2014-01-30 06:32:14,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b222111 >2014-01-30 06:32:14,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4cd7e7dd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83d9b258}, log id: 7b222111 >2014-01-30 06:32:14,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4fa9bf6b >2014-01-30 06:32:15,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4fa9bf6b >2014-01-30 06:32:15,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 294e45ed >2014-01-30 06:32:15,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 294e45ed >2014-01-30 06:32:17,293 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] No up server in cluster >2014-01-30 06:32:17,293 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:32:17,296 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] No up server in cluster >2014-01-30 06:32:17,296 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:32:17,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 65d82774 >2014-01-30 06:32:17,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 65d82774 >2014-01-30 06:32:17,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 58fd10a6 >2014-01-30 06:32:18,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterTasksListVDSCommand, return: [], log id: 58fd10a6 >2014-01-30 06:32:20,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 61699335 >2014-01-30 06:32:20,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 61699335 >2014-01-30 06:32:20,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26f2a6e8 >2014-01-30 06:32:21,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92d1c6d5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4a0d545}, log id: 26f2a6e8 >2014-01-30 06:32:21,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 620fcb3c >2014-01-30 06:32:21,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 620fcb3c >2014-01-30 06:32:21,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b63dbc >2014-01-30 06:32:21,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b63dbc >2014-01-30 06:32:26,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48da4b56 >2014-01-30 06:32:27,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 48da4b56 >2014-01-30 06:32:27,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 55dfab4a >2014-01-30 06:32:27,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ea085f1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a6d37d}, log id: 55dfab4a >2014-01-30 06:32:27,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1e97119d >2014-01-30 06:32:28,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1e97119d >2014-01-30 06:32:28,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7ea23c01 >2014-01-30 06:32:28,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ea23c01 >2014-01-30 06:32:33,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 47849e76 >2014-01-30 06:32:34,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 47849e76 >2014-01-30 06:32:34,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65417443 >2014-01-30 06:32:34,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8647a1c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@687ddb8}, log id: 65417443 >2014-01-30 06:32:34,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6563e643 >2014-01-30 06:32:34,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6563e643 >2014-01-30 06:32:34,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e4a6b2b >2014-01-30 06:32:35,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e4a6b2b >2014-01-30 06:32:40,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 47b38947 >2014-01-30 06:32:40,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 47b38947 >2014-01-30 06:32:40,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f6fa81 >2014-01-30 06:32:40,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3392f4e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1399c30d}, log id: 7f6fa81 >2014-01-30 06:32:40,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: dae26b5 >2014-01-30 06:32:41,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: dae26b5 >2014-01-30 06:32:41,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 51b9e804 >2014-01-30 06:32:41,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51b9e804 >2014-01-30 06:32:46,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d8f7231 >2014-01-30 06:32:47,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: d8f7231 >2014-01-30 06:32:47,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a3315c3 >2014-01-30 06:32:47,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ddc43855, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8e28edb}, log id: 7a3315c3 >2014-01-30 06:32:47,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 33f67444 >2014-01-30 06:32:47,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 33f67444 >2014-01-30 06:32:47,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 10d982b9 >2014-01-30 06:32:48,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10d982b9 >2014-01-30 06:32:53,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c910f26 >2014-01-30 06:32:53,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c910f26 >2014-01-30 06:32:53,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7aab72c3 >2014-01-30 06:32:53,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab510d43, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@451ae59c}, log id: 7aab72c3 >2014-01-30 06:32:53,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2d5c5cb2 >2014-01-30 06:32:54,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2d5c5cb2 >2014-01-30 06:32:54,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 60a8a794 >2014-01-30 06:32:54,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60a8a794 >2014-01-30 06:32:59,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13e0ba0 >2014-01-30 06:33:00,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 13e0ba0 >2014-01-30 06:33:00,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c7d115d >2014-01-30 06:33:00,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@821df28e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c0bfcbd}, log id: 5c7d115d >2014-01-30 06:33:00,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4193d461 >2014-01-30 06:33:00,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4193d461 >2014-01-30 06:33:00,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: c453290 >2014-01-30 06:33:01,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c453290 >2014-01-30 06:33:06,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e41a4e9 >2014-01-30 06:33:06,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1e41a4e9 >2014-01-30 06:33:06,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 186b8c4f >2014-01-30 06:33:06,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfba801a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6537e114}, log id: 186b8c4f >2014-01-30 06:33:06,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5abd16de >2014-01-30 06:33:07,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5abd16de >2014-01-30 06:33:07,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4b5e090d >2014-01-30 06:33:07,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b5e090d >2014-01-30 06:33:12,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f5479fd >2014-01-30 06:33:13,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f5479fd >2014-01-30 06:33:13,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 749fd578 >2014-01-30 06:33:13,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1f4c324, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0528ccc}, log id: 749fd578 >2014-01-30 06:33:13,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 20d0fbe5 >2014-01-30 06:33:14,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 20d0fbe5 >2014-01-30 06:33:14,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 132baeed >2014-01-30 06:33:14,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 132baeed >2014-01-30 06:33:18,117 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) [3472ce94] No up server in cluster >2014-01-30 06:33:18,117 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) [3472ce94] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:33:18,120 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) [3472ce94] No up server in cluster >2014-01-30 06:33:18,120 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) [3472ce94] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:33:18,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 589c9836 >2014-01-30 06:33:18,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 589c9836 >2014-01-30 06:33:18,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 57095b44 >2014-01-30 06:33:18,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterTasksListVDSCommand, return: [], log id: 57095b44 >2014-01-30 06:33:19,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3849eea4 >2014-01-30 06:33:19,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3849eea4 >2014-01-30 06:33:19,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f21fc36 >2014-01-30 06:33:20,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@feebe6aa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f4a2a2b}, log id: 1f21fc36 >2014-01-30 06:33:20,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 27bba816 >2014-01-30 06:33:20,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 27bba816 >2014-01-30 06:33:20,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4512b04e >2014-01-30 06:33:20,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4512b04e >2014-01-30 06:33:25,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 70cd90cf >2014-01-30 06:33:26,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 70cd90cf >2014-01-30 06:33:26,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17badde >2014-01-30 06:33:26,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5c80f23, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd513f49}, log id: 17badde >2014-01-30 06:33:26,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7e7d14eb >2014-01-30 06:33:27,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7e7d14eb >2014-01-30 06:33:27,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4675e089 >2014-01-30 06:33:27,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4675e089 >2014-01-30 06:33:32,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 394721f4 >2014-01-30 06:33:32,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 394721f4 >2014-01-30 06:33:32,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b59a01a >2014-01-30 06:33:33,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19ec5846, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@377b0f22}, log id: 2b59a01a >2014-01-30 06:33:33,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 69d98b3b >2014-01-30 06:33:33,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 69d98b3b >2014-01-30 06:33:33,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 38b534d2 >2014-01-30 06:33:33,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38b534d2 >2014-01-30 06:33:38,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 507f1aaa >2014-01-30 06:33:39,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 507f1aaa >2014-01-30 06:33:39,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24c0816f >2014-01-30 06:33:39,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f010d259, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bee10803}, log id: 24c0816f >2014-01-30 06:33:39,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1a46926c >2014-01-30 06:33:40,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1a46926c >2014-01-30 06:33:40,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4fe707ad >2014-01-30 06:33:40,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fe707ad >2014-01-30 06:33:45,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a76f65e >2014-01-30 06:33:45,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a76f65e >2014-01-30 06:33:45,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 412c399d >2014-01-30 06:33:46,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ecf3a22, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f708febd}, log id: 412c399d >2014-01-30 06:33:46,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 777176c1 >2014-01-30 06:33:46,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 777176c1 >2014-01-30 06:33:46,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 576f3d93 >2014-01-30 06:33:47,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 576f3d93 >2014-01-30 06:33:52,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 57e51ff9 >2014-01-30 06:33:52,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 57e51ff9 >2014-01-30 06:33:52,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c01d9ff >2014-01-30 06:33:52,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25bcbee, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48ac7b95}, log id: c01d9ff >2014-01-30 06:33:52,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: cc6f85c >2014-01-30 06:33:53,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: cc6f85c >2014-01-30 06:33:53,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 29b6c955 >2014-01-30 06:33:53,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29b6c955 >2014-01-30 06:33:58,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71fd296 >2014-01-30 06:33:59,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 71fd296 >2014-01-30 06:33:59,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f3a8c73 >2014-01-30 06:33:59,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a04cb531, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78536c4d}, log id: 6f3a8c73 >2014-01-30 06:33:59,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5f9628ec >2014-01-30 06:33:59,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5f9628ec >2014-01-30 06:33:59,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 343a1969 >2014-01-30 06:34:00,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 343a1969 >2014-01-30 06:34:05,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 491c30f0 >2014-01-30 06:34:05,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 491c30f0 >2014-01-30 06:34:05,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26e95b24 >2014-01-30 06:34:05,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92b83b8d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69864173}, log id: 26e95b24 >2014-01-30 06:34:05,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 57f7d9dd >2014-01-30 06:34:06,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 57f7d9dd >2014-01-30 06:34:06,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 60d23338 >2014-01-30 06:34:06,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60d23338 >2014-01-30 06:34:11,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 617260fe >2014-01-30 06:34:12,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 617260fe >2014-01-30 06:34:12,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22127951 >2014-01-30 06:34:12,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d145cd0c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e7c27a3}, log id: 22127951 >2014-01-30 06:34:12,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4b784d7b >2014-01-30 06:34:12,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4b784d7b >2014-01-30 06:34:12,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2abbc6b4 >2014-01-30 06:34:13,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2abbc6b4 >2014-01-30 06:34:18,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3929b541 >2014-01-30 06:34:18,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3929b541 >2014-01-30 06:34:18,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16d6b663 >2014-01-30 06:34:18,962 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) [1f17c565] No up server in cluster >2014-01-30 06:34:18,962 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) [1f17c565] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:34:18,964 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) [1f17c565] No up server in cluster >2014-01-30 06:34:18,964 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) [1f17c565] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:34:18,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 791bdba9 >2014-01-30 06:34:19,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a67fb6f5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c967f64}, log id: 16d6b663 >2014-01-30 06:34:19,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 57798afb >2014-01-30 06:34:19,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 791bdba9 >2014-01-30 06:34:19,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 324e91ad >2014-01-30 06:34:19,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 57798afb >2014-01-30 06:34:19,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 48c206d3 >2014-01-30 06:34:19,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48c206d3 >2014-01-30 06:34:19,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterTasksListVDSCommand, return: [], log id: 324e91ad >2014-01-30 06:34:24,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24fccf55 >2014-01-30 06:34:25,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 24fccf55 >2014-01-30 06:34:25,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c5164f6 >2014-01-30 06:34:25,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f86e9ce7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@531ce1f9}, log id: 6c5164f6 >2014-01-30 06:34:25,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1238a947 >2014-01-30 06:34:26,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1238a947 >2014-01-30 06:34:26,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7063fcfc >2014-01-30 06:34:26,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7063fcfc >2014-01-30 06:34:31,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b6cdd1b >2014-01-30 06:34:31,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2b6cdd1b >2014-01-30 06:34:31,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 47706061 >2014-01-30 06:34:32,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c55cf811, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@873f414d}, log id: 47706061 >2014-01-30 06:34:32,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 35e43abb >2014-01-30 06:34:32,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 35e43abb >2014-01-30 06:34:32,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2e1899f1 >2014-01-30 06:34:32,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e1899f1 >2014-01-30 06:34:37,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 588f774f >2014-01-30 06:34:38,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 588f774f >2014-01-30 06:34:38,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66658424 >2014-01-30 06:34:38,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bb87df9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2512510}, log id: 66658424 >2014-01-30 06:34:38,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4934e129 >2014-01-30 06:34:39,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4934e129 >2014-01-30 06:34:39,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 419d3ace >2014-01-30 06:34:39,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 419d3ace >2014-01-30 06:34:44,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e159302 >2014-01-30 06:34:44,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: e159302 >2014-01-30 06:34:44,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d2097e8 >2014-01-30 06:34:45,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4ffec82, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db660b4d}, log id: 4d2097e8 >2014-01-30 06:34:45,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 50154bc3 >2014-01-30 06:34:45,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 50154bc3 >2014-01-30 06:34:45,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 793a5c39 >2014-01-30 06:34:45,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 793a5c39 >2014-01-30 06:34:50,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a375d4 >2014-01-30 06:34:51,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a375d4 >2014-01-30 06:34:51,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5351220f >2014-01-30 06:34:51,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@201e98d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@afad3fa7}, log id: 5351220f >2014-01-30 06:34:51,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1b0f843e >2014-01-30 06:34:52,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1b0f843e >2014-01-30 06:34:52,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 15a8f14d >2014-01-30 06:34:52,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15a8f14d >2014-01-30 06:34:57,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 61b253aa >2014-01-30 06:34:58,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 61b253aa >2014-01-30 06:34:58,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25587865 >2014-01-30 06:34:58,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2684a03, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27d9b48e}, log id: 25587865 >2014-01-30 06:34:58,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4c7fd88d >2014-01-30 06:34:58,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4c7fd88d >2014-01-30 06:34:58,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1e32086c >2014-01-30 06:34:59,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e32086c >2014-01-30 06:35:04,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1db23a84 >2014-01-30 06:35:04,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1db23a84 >2014-01-30 06:35:04,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e6f7d81 >2014-01-30 06:35:04,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a9c3c2a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed41d07a}, log id: 7e6f7d81 >2014-01-30 06:35:04,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 524b183a >2014-01-30 06:35:05,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 524b183a >2014-01-30 06:35:05,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d93558e >2014-01-30 06:35:05,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d93558e >2014-01-30 06:35:06,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 509dc775 >2014-01-30 06:35:06,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@17605c70, log id: 509dc775 >2014-01-30 06:35:06,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3754c90d >2014-01-30 06:35:06,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6ad70098, log id: 3754c90d >2014-01-30 06:35:10,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48fb7e05 >2014-01-30 06:35:11,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 48fb7e05 >2014-01-30 06:35:11,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50b9730b >2014-01-30 06:35:11,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0a726e8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c75e86bb}, log id: 50b9730b >2014-01-30 06:35:11,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 36215419 >2014-01-30 06:35:11,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 36215419 >2014-01-30 06:35:11,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 635a03c0 >2014-01-30 06:35:12,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 635a03c0 >2014-01-30 06:35:17,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 719d4c76 >2014-01-30 06:35:17,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 719d4c76 >2014-01-30 06:35:17,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6599f141 >2014-01-30 06:35:18,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9ce6dca, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ee3cce8}, log id: 6599f141 >2014-01-30 06:35:18,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5b4875d5 >2014-01-30 06:35:18,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5b4875d5 >2014-01-30 06:35:18,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1c00986e >2014-01-30 06:35:18,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c00986e >2014-01-30 06:35:19,728 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] No up server in cluster >2014-01-30 06:35:19,728 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:35:19,732 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] No up server in cluster >2014-01-30 06:35:19,732 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:35:19,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 4aa575ef >2014-01-30 06:35:20,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4aa575ef >2014-01-30 06:35:20,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 17d38fdb >2014-01-30 06:35:20,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterTasksListVDSCommand, return: [], log id: 17d38fdb >2014-01-30 06:35:23,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21dba112 >2014-01-30 06:35:24,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 21dba112 >2014-01-30 06:35:24,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c3c0c64 >2014-01-30 06:35:24,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1ad50a5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1b068e5}, log id: 6c3c0c64 >2014-01-30 06:35:24,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 51ee9847 >2014-01-30 06:35:25,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 51ee9847 >2014-01-30 06:35:25,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2e9ce53a >2014-01-30 06:35:25,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e9ce53a >2014-01-30 06:35:30,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 670f8e2d >2014-01-30 06:35:30,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 670f8e2d >2014-01-30 06:35:30,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 578019cf >2014-01-30 06:35:31,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e778b0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c53a1189}, log id: 578019cf >2014-01-30 06:35:31,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5d8f7e01 >2014-01-30 06:35:31,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5d8f7e01 >2014-01-30 06:35:31,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 69383470 >2014-01-30 06:35:31,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 69383470 >2014-01-30 06:35:36,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71e54cb5 >2014-01-30 06:35:37,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 71e54cb5 >2014-01-30 06:35:37,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1dd97b5a >2014-01-30 06:35:37,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5099a04, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@baf33441}, log id: 1dd97b5a >2014-01-30 06:35:37,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65402e82 >2014-01-30 06:35:38,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 65402e82 >2014-01-30 06:35:38,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6f59803e >2014-01-30 06:35:38,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f59803e >2014-01-30 06:35:43,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e9df599 >2014-01-30 06:35:44,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e9df599 >2014-01-30 06:35:44,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 417cbf25 >2014-01-30 06:35:44,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f094dc4b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55d13e39}, log id: 417cbf25 >2014-01-30 06:35:44,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 283b445e >2014-01-30 06:35:44,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 283b445e >2014-01-30 06:35:44,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4a924d34 >2014-01-30 06:35:45,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a924d34 >2014-01-30 06:35:50,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a5c33de >2014-01-30 06:35:50,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7a5c33de >2014-01-30 06:35:50,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 731fec0c >2014-01-30 06:35:50,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2662b44c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d7202c9}, log id: 731fec0c >2014-01-30 06:35:50,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6c562843 >2014-01-30 06:35:51,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6c562843 >2014-01-30 06:35:51,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: a1ac6a5 >2014-01-30 06:35:51,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a1ac6a5 >2014-01-30 06:35:56,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4fe2128b >2014-01-30 06:35:57,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4fe2128b >2014-01-30 06:35:57,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 39e490fd >2014-01-30 06:35:57,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38d4927c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85b27576}, log id: 39e490fd >2014-01-30 06:35:57,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ab21948 >2014-01-30 06:35:58,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3ab21948 >2014-01-30 06:35:58,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 66460f3d >2014-01-30 06:35:58,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66460f3d >2014-01-30 06:36:03,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 62fb6682 >2014-01-30 06:36:03,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 62fb6682 >2014-01-30 06:36:03,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 211b712e >2014-01-30 06:36:04,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac82f632, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1985b4f}, log id: 211b712e >2014-01-30 06:36:04,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5ab3ad3f >2014-01-30 06:36:04,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5ab3ad3f >2014-01-30 06:36:04,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4202caf8 >2014-01-30 06:36:04,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4202caf8 >2014-01-30 06:36:09,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40675495 >2014-01-30 06:36:10,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 40675495 >2014-01-30 06:36:10,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c05529a >2014-01-30 06:36:10,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85a2363b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5063115}, log id: 1c05529a >2014-01-30 06:36:10,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6d3b359 >2014-01-30 06:36:11,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6d3b359 >2014-01-30 06:36:11,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 26dfe5fa >2014-01-30 06:36:11,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26dfe5fa >2014-01-30 06:36:16,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24194604 >2014-01-30 06:36:16,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 24194604 >2014-01-30 06:36:16,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 216061d3 >2014-01-30 06:36:17,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce5f32ac, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1697616}, log id: 216061d3 >2014-01-30 06:36:17,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 119a3892 >2014-01-30 06:36:17,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 119a3892 >2014-01-30 06:36:17,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4146c9bc >2014-01-30 06:36:17,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4146c9bc >2014-01-30 06:36:20,542 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-14) [511b856] No up server in cluster >2014-01-30 06:36:20,542 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:36:20,545 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-14) [511b856] No up server in cluster >2014-01-30 06:36:20,545 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:36:20,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 28b46b9e >2014-01-30 06:36:21,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 28b46b9e >2014-01-30 06:36:21,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 280bd4a4 >2014-01-30 06:36:21,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterTasksListVDSCommand, return: [], log id: 280bd4a4 >2014-01-30 06:36:22,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 368364f5 >2014-01-30 06:36:23,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 368364f5 >2014-01-30 06:36:23,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c7e8b89 >2014-01-30 06:36:23,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d7173b9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c226d10}, log id: 4c7e8b89 >2014-01-30 06:36:23,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 74a6c1b4 >2014-01-30 06:36:24,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 74a6c1b4 >2014-01-30 06:36:24,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 22262bd9 >2014-01-30 06:36:24,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22262bd9 >2014-01-30 06:36:29,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48466bc2 >2014-01-30 06:36:29,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 48466bc2 >2014-01-30 06:36:29,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e65b519 >2014-01-30 06:36:30,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d5459f6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0839265}, log id: 6e65b519 >2014-01-30 06:36:30,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 777f813b >2014-01-30 06:36:30,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 777f813b >2014-01-30 06:36:30,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 9d3a297 >2014-01-30 06:36:30,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9d3a297 >2014-01-30 06:36:35,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 476ccf1f >2014-01-30 06:36:36,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 476ccf1f >2014-01-30 06:36:36,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 252d361c >2014-01-30 06:36:36,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b374cf46, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4001867f}, log id: 252d361c >2014-01-30 06:36:36,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 29aeb97a >2014-01-30 06:36:37,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 29aeb97a >2014-01-30 06:36:37,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1afb8504 >2014-01-30 06:36:37,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1afb8504 >2014-01-30 06:36:42,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c5b4535 >2014-01-30 06:36:42,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c5b4535 >2014-01-30 06:36:42,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f16962d >2014-01-30 06:36:43,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bc812a9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@739b0a47}, log id: 6f16962d >2014-01-30 06:36:43,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 338e1692 >2014-01-30 06:36:43,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 338e1692 >2014-01-30 06:36:43,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: f18cf30 >2014-01-30 06:36:44,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f18cf30 >2014-01-30 06:36:49,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c51509b >2014-01-30 06:36:49,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: c51509b >2014-01-30 06:36:49,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71b19fa >2014-01-30 06:36:49,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb08d262, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78b22b5f}, log id: 71b19fa >2014-01-30 06:36:49,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 90b6ea9 >2014-01-30 06:36:50,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 90b6ea9 >2014-01-30 06:36:50,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 74f171ad >2014-01-30 06:36:50,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74f171ad >2014-01-30 06:36:55,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5845bcc8 >2014-01-30 06:36:56,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5845bcc8 >2014-01-30 06:36:56,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29d05a18 >2014-01-30 06:36:56,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de982e9b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fc7b24c}, log id: 29d05a18 >2014-01-30 06:36:56,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 106eb208 >2014-01-30 06:36:56,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 106eb208 >2014-01-30 06:36:56,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77615538 >2014-01-30 06:36:57,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77615538 >2014-01-30 06:37:02,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43aaef91 >2014-01-30 06:37:02,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43aaef91 >2014-01-30 06:37:02,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27044981 >2014-01-30 06:37:03,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ccf19ec, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b96a50f6}, log id: 27044981 >2014-01-30 06:37:03,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ba8b717 >2014-01-30 06:37:03,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: ba8b717 >2014-01-30 06:37:03,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2252f74f >2014-01-30 06:37:03,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2252f74f >2014-01-30 06:37:08,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19c182c7 >2014-01-30 06:37:09,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 19c182c7 >2014-01-30 06:37:09,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 208677ce >2014-01-30 06:37:09,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0773fc1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@768d0d9f}, log id: 208677ce >2014-01-30 06:37:09,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 676aa7ee >2014-01-30 06:37:10,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 676aa7ee >2014-01-30 06:37:10,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d8b3c8 >2014-01-30 06:37:10,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d8b3c8 >2014-01-30 06:37:15,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e90fb62 >2014-01-30 06:37:15,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e90fb62 >2014-01-30 06:37:15,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 678cfffb >2014-01-30 06:37:16,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a43029e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1878353a}, log id: 678cfffb >2014-01-30 06:37:16,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2c03bfbc >2014-01-30 06:37:16,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2c03bfbc >2014-01-30 06:37:16,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2db37e15 >2014-01-30 06:37:16,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2db37e15 >2014-01-30 06:37:21,394 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-97) [717bad08] No up server in cluster >2014-01-30 06:37:21,394 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-97) [717bad08] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:37:21,397 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-97) [717bad08] No up server in cluster >2014-01-30 06:37:21,397 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-97) [717bad08] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:37:21,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 78ee0bac >2014-01-30 06:37:21,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ceea940 >2014-01-30 06:37:21,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 78ee0bac >2014-01-30 06:37:21,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 39bd59c3 >2014-01-30 06:37:22,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterTasksListVDSCommand, return: [], log id: 39bd59c3 >2014-01-30 06:37:22,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3ceea940 >2014-01-30 06:37:22,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 784f4d61 >2014-01-30 06:37:22,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ca556e8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fa3feae}, log id: 784f4d61 >2014-01-30 06:37:22,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: a3cda42 >2014-01-30 06:37:23,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: a3cda42 >2014-01-30 06:37:23,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 44322966 >2014-01-30 06:37:23,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44322966 >2014-01-30 06:37:28,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b5334dc >2014-01-30 06:37:28,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b5334dc >2014-01-30 06:37:28,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4bba41b3 >2014-01-30 06:37:29,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4a9d0c3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2e57428}, log id: 4bba41b3 >2014-01-30 06:37:29,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6361b2e2 >2014-01-30 06:37:29,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6361b2e2 >2014-01-30 06:37:29,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6eda82cc >2014-01-30 06:37:29,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6eda82cc >2014-01-30 06:37:35,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40e33fb8 >2014-01-30 06:37:35,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 40e33fb8 >2014-01-30 06:37:35,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c000087 >2014-01-30 06:37:35,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@200e8d75, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb402880}, log id: 2c000087 >2014-01-30 06:37:35,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4220023 >2014-01-30 06:37:36,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4220023 >2014-01-30 06:37:36,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 13be4ecf >2014-01-30 06:37:36,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13be4ecf >2014-01-30 06:37:41,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1adef0d7 >2014-01-30 06:37:42,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1adef0d7 >2014-01-30 06:37:42,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b56f117 >2014-01-30 06:37:42,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb4e9462, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bee348e}, log id: b56f117 >2014-01-30 06:37:42,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4c571894 >2014-01-30 06:37:42,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4c571894 >2014-01-30 06:37:42,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 18fbdf6f >2014-01-30 06:37:43,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18fbdf6f >2014-01-30 06:37:48,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2cda3be2 >2014-01-30 06:37:48,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2cda3be2 >2014-01-30 06:37:48,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3dfecb5a >2014-01-30 06:37:48,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f0f5b3e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29de427d}, log id: 3dfecb5a >2014-01-30 06:37:48,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 73ee378e >2014-01-30 06:37:49,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 73ee378e >2014-01-30 06:37:49,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1d2c01f9 >2014-01-30 06:37:49,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d2c01f9 >2014-01-30 06:37:54,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f6cd120 >2014-01-30 06:37:55,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: f6cd120 >2014-01-30 06:37:55,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: bf7bc29 >2014-01-30 06:37:55,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc406d72, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1311855d}, log id: bf7bc29 >2014-01-30 06:37:55,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 14a6519 >2014-01-30 06:37:55,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 14a6519 >2014-01-30 06:37:55,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2db0c427 >2014-01-30 06:37:56,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2db0c427 >2014-01-30 06:38:01,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e1efb78 >2014-01-30 06:38:01,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: e1efb78 >2014-01-30 06:38:01,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2649c910 >2014-01-30 06:38:02,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d721c8f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d3127c1}, log id: 2649c910 >2014-01-30 06:38:02,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 20c49f75 >2014-01-30 06:38:02,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 20c49f75 >2014-01-30 06:38:02,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77019388 >2014-01-30 06:38:02,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77019388 >2014-01-30 06:38:07,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16a2d70c >2014-01-30 06:38:08,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 16a2d70c >2014-01-30 06:38:08,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 683d9aa4 >2014-01-30 06:38:08,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3738f612, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fd0596f}, log id: 683d9aa4 >2014-01-30 06:38:08,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ae155e5 >2014-01-30 06:38:09,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6ae155e5 >2014-01-30 06:38:09,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 8b8dc0a >2014-01-30 06:38:09,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8b8dc0a >2014-01-30 06:38:14,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e191ab4 >2014-01-30 06:38:14,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4e191ab4 >2014-01-30 06:38:14,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35356dd5 >2014-01-30 06:38:15,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ead1887, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a05e277b}, log id: 35356dd5 >2014-01-30 06:38:15,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3a63109f >2014-01-30 06:38:15,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3a63109f >2014-01-30 06:38:15,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 272ab96c >2014-01-30 06:38:15,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 272ab96c >2014-01-30 06:38:20,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4aab44fa >2014-01-30 06:38:21,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4aab44fa >2014-01-30 06:38:21,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d36d8ae >2014-01-30 06:38:21,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccf5c71, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb3bbaa4}, log id: 6d36d8ae >2014-01-30 06:38:21,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 12b75f69 >2014-01-30 06:38:22,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 12b75f69 >2014-01-30 06:38:22,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 50280bcf >2014-01-30 06:38:22,222 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-65) [227486be] No up server in cluster >2014-01-30 06:38:22,223 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-65) [227486be] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:38:22,224 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-65) [227486be] No up server in cluster >2014-01-30 06:38:22,225 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-65) [227486be] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:38:22,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 21dd3858 >2014-01-30 06:38:22,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50280bcf >2014-01-30 06:38:22,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 21dd3858 >2014-01-30 06:38:22,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1becf3e6 >2014-01-30 06:38:23,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterTasksListVDSCommand, return: [], log id: 1becf3e6 >2014-01-30 06:38:27,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6427f929 >2014-01-30 06:38:27,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6427f929 >2014-01-30 06:38:27,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53806910 >2014-01-30 06:38:28,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@158ebbe7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@602a48e0}, log id: 53806910 >2014-01-30 06:38:28,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6111387e >2014-01-30 06:38:28,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6111387e >2014-01-30 06:38:28,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 27addba3 >2014-01-30 06:38:28,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27addba3 >2014-01-30 06:38:33,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43346a52 >2014-01-30 06:38:34,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43346a52 >2014-01-30 06:38:34,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26cb7ac6 >2014-01-30 06:38:34,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9e1c0f7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37183431}, log id: 26cb7ac6 >2014-01-30 06:38:34,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 9456bbc >2014-01-30 06:38:35,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 9456bbc >2014-01-30 06:38:35,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 378768e >2014-01-30 06:38:35,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 378768e >2014-01-30 06:38:40,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b70a6b5 >2014-01-30 06:38:40,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b70a6b5 >2014-01-30 06:38:40,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fa84b09 >2014-01-30 06:38:41,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aafb0236, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efa2fb3e}, log id: 3fa84b09 >2014-01-30 06:38:41,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5f784de2 >2014-01-30 06:38:41,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5f784de2 >2014-01-30 06:38:41,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 48e43c28 >2014-01-30 06:38:42,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48e43c28 >2014-01-30 06:38:47,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3191d20e >2014-01-30 06:38:47,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3191d20e >2014-01-30 06:38:47,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41a1a59 >2014-01-30 06:38:47,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae7c5b6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f580fb9}, log id: 41a1a59 >2014-01-30 06:38:47,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5cd4ddd7 >2014-01-30 06:38:48,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5cd4ddd7 >2014-01-30 06:38:48,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 24feefc4 >2014-01-30 06:38:48,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24feefc4 >2014-01-30 06:38:53,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46740a8 >2014-01-30 06:38:54,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 46740a8 >2014-01-30 06:38:54,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 286421b4 >2014-01-30 06:38:54,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@577fd76d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1744e68}, log id: 286421b4 >2014-01-30 06:38:54,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 32b419b >2014-01-30 06:38:54,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 32b419b >2014-01-30 06:38:54,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3b992ddf >2014-01-30 06:38:55,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b992ddf >2014-01-30 06:39:00,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b551fcc >2014-01-30 06:39:00,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4b551fcc >2014-01-30 06:39:00,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 61bcf370 >2014-01-30 06:39:00,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@392a52b7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d9fbbcf}, log id: 61bcf370 >2014-01-30 06:39:00,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 50814eee >2014-01-30 06:39:01,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 50814eee >2014-01-30 06:39:01,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 104b18fd >2014-01-30 06:39:01,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 104b18fd >2014-01-30 06:39:06,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48db7b25 >2014-01-30 06:39:07,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 48db7b25 >2014-01-30 06:39:07,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72401505 >2014-01-30 06:39:07,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22056a60, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15384a40}, log id: 72401505 >2014-01-30 06:39:07,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2f1f8d29 >2014-01-30 06:39:07,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2f1f8d29 >2014-01-30 06:39:07,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 57dc8519 >2014-01-30 06:39:08,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57dc8519 >2014-01-30 06:39:13,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12694678 >2014-01-30 06:39:13,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 12694678 >2014-01-30 06:39:13,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12eb5362 >2014-01-30 06:39:14,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b2a65e4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4178c634}, log id: 12eb5362 >2014-01-30 06:39:14,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 674c830c >2014-01-30 06:39:14,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 674c830c >2014-01-30 06:39:14,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6a1a0ad >2014-01-30 06:39:14,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a1a0ad >2014-01-30 06:39:19,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6253479c >2014-01-30 06:39:20,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6253479c >2014-01-30 06:39:20,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e5ff7be >2014-01-30 06:39:20,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99022169, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc33b4a}, log id: 3e5ff7be >2014-01-30 06:39:20,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ee5f425 >2014-01-30 06:39:21,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: ee5f425 >2014-01-30 06:39:21,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7236acf9 >2014-01-30 06:39:21,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7236acf9 >2014-01-30 06:39:23,023 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] No up server in cluster >2014-01-30 06:39:23,023 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:39:23,025 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] No up server in cluster >2014-01-30 06:39:23,026 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:39:23,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 31460f53 >2014-01-30 06:39:23,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 31460f53 >2014-01-30 06:39:23,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 50adb3a3 >2014-01-30 06:39:23,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterTasksListVDSCommand, return: [], log id: 50adb3a3 >2014-01-30 06:39:26,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54fca90a >2014-01-30 06:39:26,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 54fca90a >2014-01-30 06:39:26,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60e3fb5c >2014-01-30 06:39:27,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5609692e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75fe4a09}, log id: 60e3fb5c >2014-01-30 06:39:27,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 617961a9 >2014-01-30 06:39:27,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 617961a9 >2014-01-30 06:39:27,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ec37ac9 >2014-01-30 06:39:27,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ec37ac9 >2014-01-30 06:39:32,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d15af67 >2014-01-30 06:39:33,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2d15af67 >2014-01-30 06:39:33,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c0f6894 >2014-01-30 06:39:33,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2589896f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9f2b51b}, log id: 2c0f6894 >2014-01-30 06:39:33,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2e925975 >2014-01-30 06:39:34,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2e925975 >2014-01-30 06:39:34,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4185f5d6 >2014-01-30 06:39:34,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4185f5d6 >2014-01-30 06:39:39,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 727867bb >2014-01-30 06:39:39,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 727867bb >2014-01-30 06:39:39,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 186c7e47 >2014-01-30 06:39:40,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d41adfd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c4fe365}, log id: 186c7e47 >2014-01-30 06:39:40,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6fe63a3c >2014-01-30 06:39:40,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6fe63a3c >2014-01-30 06:39:40,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 63282ea4 >2014-01-30 06:39:41,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63282ea4 >2014-01-30 06:39:46,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44221327 >2014-01-30 06:39:46,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 44221327 >2014-01-30 06:39:46,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66e2c2d6 >2014-01-30 06:39:46,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4a00375, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45ca6fa1}, log id: 66e2c2d6 >2014-01-30 06:39:46,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7eec7881 >2014-01-30 06:39:47,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7eec7881 >2014-01-30 06:39:47,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 59ef651f >2014-01-30 06:39:47,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59ef651f >2014-01-30 06:39:52,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: fb83a98 >2014-01-30 06:39:53,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: fb83a98 >2014-01-30 06:39:53,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2497a458 >2014-01-30 06:39:53,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c15aaa1f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0f27fae}, log id: 2497a458 >2014-01-30 06:39:53,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: b20e83 >2014-01-30 06:39:53,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: b20e83 >2014-01-30 06:39:53,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2f5ad70d >2014-01-30 06:39:54,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f5ad70d >2014-01-30 06:39:59,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52f0f2ed >2014-01-30 06:39:59,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 52f0f2ed >2014-01-30 06:39:59,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37ca03d4 >2014-01-30 06:39:59,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8949df6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c07f6267}, log id: 37ca03d4 >2014-01-30 06:40:00,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: e8dda3f >2014-01-30 06:40:00,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: e8dda3f >2014-01-30 06:40:00,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 482bfc02 >2014-01-30 06:40:00,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 482bfc02 >2014-01-30 06:40:05,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e92170 >2014-01-30 06:40:06,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1e92170 >2014-01-30 06:40:06,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 876ca16 >2014-01-30 06:40:06,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52909a9d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@959a6370}, log id: 876ca16 >2014-01-30 06:40:06,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1b7b3d1c >2014-01-30 06:40:06,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 149e8aa0 >2014-01-30 06:40:07,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@ef93d24, log id: 149e8aa0 >2014-01-30 06:40:07,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d1d0e2a >2014-01-30 06:40:07,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1b7b3d1c >2014-01-30 06:40:07,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: b1fbb78 >2014-01-30 06:40:07,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b1fbb78 >2014-01-30 06:40:07,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@561ef6b3, log id: d1d0e2a >2014-01-30 06:40:12,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56ab3e3e >2014-01-30 06:40:12,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 56ab3e3e >2014-01-30 06:40:12,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 136c2b76 >2014-01-30 06:40:13,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b7de372, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86dd4f84}, log id: 136c2b76 >2014-01-30 06:40:13,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d15a1b >2014-01-30 06:40:13,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7d15a1b >2014-01-30 06:40:13,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: f85ed46 >2014-01-30 06:40:13,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f85ed46 >2014-01-30 06:40:18,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 63528749 >2014-01-30 06:40:19,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 63528749 >2014-01-30 06:40:19,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c05a420 >2014-01-30 06:40:19,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c97964c4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@601385d}, log id: 6c05a420 >2014-01-30 06:40:19,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2fad1856 >2014-01-30 06:40:20,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2fad1856 >2014-01-30 06:40:20,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3d968167 >2014-01-30 06:40:20,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d968167 >2014-01-30 06:40:23,865 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] No up server in cluster >2014-01-30 06:40:23,865 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:40:23,868 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] No up server in cluster >2014-01-30 06:40:23,868 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:40:23,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 2770d75d >2014-01-30 06:40:24,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 2770d75d >2014-01-30 06:40:24,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 4b82ecab >2014-01-30 06:40:24,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterTasksListVDSCommand, return: [], log id: 4b82ecab >2014-01-30 06:40:25,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58ab57cc >2014-01-30 06:40:25,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 58ab57cc >2014-01-30 06:40:25,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6933adba >2014-01-30 06:40:26,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66b1418d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f25f16c}, log id: 6933adba >2014-01-30 06:40:26,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 16447cfb >2014-01-30 06:40:26,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 16447cfb >2014-01-30 06:40:26,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b627ad0 >2014-01-30 06:40:26,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b627ad0 >2014-01-30 06:40:31,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 649d3a9d >2014-01-30 06:40:32,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 649d3a9d >2014-01-30 06:40:32,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: bc7b5b >2014-01-30 06:40:32,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f3262b7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b4d6f4b}, log id: bc7b5b >2014-01-30 06:40:32,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3a10fa7 >2014-01-30 06:40:33,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3a10fa7 >2014-01-30 06:40:33,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2ecc4b7e >2014-01-30 06:40:33,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ecc4b7e >2014-01-30 06:40:38,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14f9558f >2014-01-30 06:40:39,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 14f9558f >2014-01-30 06:40:39,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68de5de2 >2014-01-30 06:40:39,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@975b62ab, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed716461}, log id: 68de5de2 >2014-01-30 06:40:39,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 66e460f7 >2014-01-30 06:40:39,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 66e460f7 >2014-01-30 06:40:39,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 401bc1f8 >2014-01-30 06:40:40,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 401bc1f8 >2014-01-30 06:40:45,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74a977d1 >2014-01-30 06:40:45,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 74a977d1 >2014-01-30 06:40:45,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d6471c9 >2014-01-30 06:40:45,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf4657e2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57eda969}, log id: 2d6471c9 >2014-01-30 06:40:45,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5f6c4363 >2014-01-30 06:40:46,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5f6c4363 >2014-01-30 06:40:46,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6e3abd58 >2014-01-30 06:40:46,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e3abd58 >2014-01-30 06:40:51,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3476e43a >2014-01-30 06:40:52,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3476e43a >2014-01-30 06:40:52,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54db4d9f >2014-01-30 06:40:52,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76fd0ede, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@133ca4e6}, log id: 54db4d9f >2014-01-30 06:40:52,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6edb15e4 >2014-01-30 06:40:52,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6edb15e4 >2014-01-30 06:40:52,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 52db4d17 >2014-01-30 06:40:53,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 52db4d17 >2014-01-30 06:40:58,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7681a50e >2014-01-30 06:40:58,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7681a50e >2014-01-30 06:40:58,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 788e5c8c >2014-01-30 06:40:58,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c03d2cac, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b01bea4}, log id: 788e5c8c >2014-01-30 06:40:59,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 256693a7 >2014-01-30 06:40:59,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 256693a7 >2014-01-30 06:40:59,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 54d50efa >2014-01-30 06:40:59,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54d50efa >2014-01-30 06:41:04,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b7fd8d8 >2014-01-30 06:41:05,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6b7fd8d8 >2014-01-30 06:41:05,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2df4d097 >2014-01-30 06:41:05,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6e75070, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40fe2d11}, log id: 2df4d097 >2014-01-30 06:41:05,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 75e903c1 >2014-01-30 06:41:06,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 75e903c1 >2014-01-30 06:41:06,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: b4b8308 >2014-01-30 06:41:06,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b4b8308 >2014-01-30 06:41:11,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7abc5cfa >2014-01-30 06:41:11,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7abc5cfa >2014-01-30 06:41:11,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77ff589e >2014-01-30 06:41:12,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@558ce984, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3d718aa}, log id: 77ff589e >2014-01-30 06:41:12,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1e2b2b07 >2014-01-30 06:41:12,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1e2b2b07 >2014-01-30 06:41:12,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2f5e0601 >2014-01-30 06:41:12,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f5e0601 >2014-01-30 06:41:17,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42f55fa8 >2014-01-30 06:41:18,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 42f55fa8 >2014-01-30 06:41:18,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 208ccc59 >2014-01-30 06:41:18,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@127ceef9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee8c87ff}, log id: 208ccc59 >2014-01-30 06:41:18,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1081c123 >2014-01-30 06:41:19,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1081c123 >2014-01-30 06:41:19,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ce56be3 >2014-01-30 06:41:19,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ce56be3 >2014-01-30 06:41:24,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2cfbc4fe >2014-01-30 06:41:24,700 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-59) [499ce58b] No up server in cluster >2014-01-30 06:41:24,700 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-59) [499ce58b] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:41:24,701 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-59) [499ce58b] No up server in cluster >2014-01-30 06:41:24,701 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-59) [499ce58b] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:41:24,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 62601c35 >2014-01-30 06:41:24,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2cfbc4fe >2014-01-30 06:41:24,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 319f16e8 >2014-01-30 06:41:25,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 62601c35 >2014-01-30 06:41:25,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2e382f1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da5f8ca2}, log id: 319f16e8 >2014-01-30 06:41:25,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 118f7352 >2014-01-30 06:41:25,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 74dbd79c >2014-01-30 06:41:25,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterTasksListVDSCommand, return: [], log id: 118f7352 >2014-01-30 06:41:25,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 74dbd79c >2014-01-30 06:41:25,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5e1dbdae >2014-01-30 06:41:25,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e1dbdae >2014-01-30 06:41:30,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e6dde0c >2014-01-30 06:41:31,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3e6dde0c >2014-01-30 06:41:31,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7fdac279 >2014-01-30 06:41:31,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@335038a7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f107038}, log id: 7fdac279 >2014-01-30 06:41:31,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5ddbac52 >2014-01-30 06:41:32,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5ddbac52 >2014-01-30 06:41:32,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 29efa218 >2014-01-30 06:41:32,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29efa218 >2014-01-30 06:41:37,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 207b1b24 >2014-01-30 06:41:37,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 207b1b24 >2014-01-30 06:41:37,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e288aa3 >2014-01-30 06:41:38,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@457f7311, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0f7c61}, log id: 5e288aa3 >2014-01-30 06:41:38,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 69222ae2 >2014-01-30 06:41:38,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 69222ae2 >2014-01-30 06:41:38,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5973bc39 >2014-01-30 06:41:39,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5973bc39 >2014-01-30 06:41:44,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33a10173 >2014-01-30 06:41:44,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 33a10173 >2014-01-30 06:41:44,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 466728cf >2014-01-30 06:41:44,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1199c6cb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16e655b8}, log id: 466728cf >2014-01-30 06:41:44,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1feee55c >2014-01-30 06:41:45,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1feee55c >2014-01-30 06:41:45,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7995da82 >2014-01-30 06:41:45,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7995da82 >2014-01-30 06:41:50,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 542fa45d >2014-01-30 06:41:51,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 542fa45d >2014-01-30 06:41:51,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35d77c2b >2014-01-30 06:41:51,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c33574a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a65eb6c}, log id: 35d77c2b >2014-01-30 06:41:51,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 31a05b74 >2014-01-30 06:41:51,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 31a05b74 >2014-01-30 06:41:51,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 285bd08d >2014-01-30 06:41:52,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 285bd08d >2014-01-30 06:41:57,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4737ece1 >2014-01-30 06:41:57,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4737ece1 >2014-01-30 06:41:57,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49789d7b >2014-01-30 06:41:57,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b8b7cef, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72903ea7}, log id: 49789d7b >2014-01-30 06:41:57,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7e511e35 >2014-01-30 06:41:58,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7e511e35 >2014-01-30 06:41:58,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2110d018 >2014-01-30 06:41:58,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2110d018 >2014-01-30 06:42:03,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22376a8a >2014-01-30 06:42:04,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 22376a8a >2014-01-30 06:42:04,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2882f8ed >2014-01-30 06:42:04,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b8af116, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41056807}, log id: 2882f8ed >2014-01-30 06:42:04,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3cc10e44 >2014-01-30 06:42:04,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3cc10e44 >2014-01-30 06:42:04,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 42a3af1c >2014-01-30 06:42:05,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42a3af1c >2014-01-30 06:42:10,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7714c42a >2014-01-30 06:42:10,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7714c42a >2014-01-30 06:42:10,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c86cd14 >2014-01-30 06:42:11,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3131605, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@103f831f}, log id: 4c86cd14 >2014-01-30 06:42:11,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 42d57d84 >2014-01-30 06:42:11,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 42d57d84 >2014-01-30 06:42:11,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 40363473 >2014-01-30 06:42:11,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40363473 >2014-01-30 06:42:16,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c31b4af >2014-01-30 06:42:17,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3c31b4af >2014-01-30 06:42:17,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c58b64c >2014-01-30 06:42:17,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d157266b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bc21061}, log id: 6c58b64c >2014-01-30 06:42:17,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2a3f8e5b >2014-01-30 06:42:18,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2a3f8e5b >2014-01-30 06:42:18,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 26493241 >2014-01-30 06:42:18,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26493241 >2014-01-30 06:42:23,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 827f819 >2014-01-30 06:42:23,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 827f819 >2014-01-30 06:42:23,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14ba2d55 >2014-01-30 06:42:24,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1b971f7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c897cdc2}, log id: 14ba2d55 >2014-01-30 06:42:24,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ee3632c >2014-01-30 06:42:24,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3ee3632c >2014-01-30 06:42:24,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 31af48f9 >2014-01-30 06:42:24,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31af48f9 >2014-01-30 06:42:25,430 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] No up server in cluster >2014-01-30 06:42:25,430 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:42:25,434 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] No up server in cluster >2014-01-30 06:42:25,434 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:42:25,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 4c039fa7 >2014-01-30 06:42:25,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4c039fa7 >2014-01-30 06:42:26,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4030814 >2014-01-30 06:42:26,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterTasksListVDSCommand, return: [], log id: 4030814 >2014-01-30 06:42:29,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21c90b6 >2014-01-30 06:42:30,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 21c90b6 >2014-01-30 06:42:30,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1bbd64cf >2014-01-30 06:42:30,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8858e09e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e76b9396}, log id: 1bbd64cf >2014-01-30 06:42:30,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6f0b10ab >2014-01-30 06:42:31,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6f0b10ab >2014-01-30 06:42:31,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1301dc65 >2014-01-30 06:42:31,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1301dc65 >2014-01-30 06:42:33,206 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-11) [7cc81051] Start refreshing all users data >2014-01-30 06:42:33,258 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-51) Attempting to update VMs/Templates Ovf. >2014-01-30 06:42:34,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-40) [511b856] START, GlusterHooksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 281c9112 >2014-01-30 06:42:34,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-43) [511b856] START, GlusterHooksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b784950 >2014-01-30 06:42:34,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-19) [511b856] START, GlusterHooksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 39c68991 >2014-01-30 06:42:34,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-36) [511b856] START, GlusterHooksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 10a0c5c >2014-01-30 06:42:34,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-40) [511b856] FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@3a3dadf6, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@fd9ccdfc, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@fc071870, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@6c1703d7, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@5fb340a2, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@33cd9f14, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@44b7ed79, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@867becf3, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@28791a77, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@72150363, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@245fd698, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@30965062, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@fc20264c], log id: 281c9112 >2014-01-30 06:42:34,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-43) [511b856] FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@ff5c8129, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@2411dbc4, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@eea8304c, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@65ed0e60, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@be1bd71a, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f3e5f80e, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@594c7cf3, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@155884a3, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@924b9d0c, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f1b06fc9, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@c4faea76, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@ced6b363, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@d5569c74], log id: 6b784950 >2014-01-30 06:42:34,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-19) [511b856] FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@5d3973e7, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@9b3d3fc3, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f639d07a, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@2873fdb2, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@91154bfc, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b908f11c, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@50c00b46, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@30db1c67, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@2e800c9e, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@6910b6f, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@78ed4dc5, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b9072fe, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@ad683762], log id: 39c68991 >2014-01-30 06:42:34,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-36) [511b856] FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@d6ee8d7d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@6cde4e2b, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@fca5be4d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@959e3f2a, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@2c9021e7, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b9f5c57, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@5b86f08f, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@87632efc, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@1d5af3b5, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@e7cb1792, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@2d209d72, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@85bbe36c, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@e72bdc7f], log id: 10a0c5c >2014-01-30 06:42:34,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-36) [511b856] START, GlusterHooksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1358f04d >2014-01-30 06:42:34,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-42) [511b856] START, GlusterHooksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 34085927 >2014-01-30 06:42:34,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-42) [511b856] FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@c453264f, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@9bee2e33, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@1aa6b790, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@243d7d87, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@19026b6, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@c177181c, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@a160c8f7, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@c93f2d76, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@ccca7bb5, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@862fe484, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@6ccc33ec, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@dcd9be72, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@589cc26, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@fec25bde, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@8f20a33d], log id: 34085927 >2014-01-30 06:42:34,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-36) [511b856] FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@556f901e, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@e487934b, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@808f296, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@65512c41, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@ad733cfe, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f22cff9d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@a0c84b7d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@7da83e6, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@57a458e7, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@59d554e2, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@474bdf9a, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@89ac71f1, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@aa668b4e, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@c60167f1, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@cfb65277, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@564e3ec6, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@c7b177f2, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b4f2ba83], log id: 1358f04d >2014-01-30 06:42:34,889 INFO [org.ovirt.engine.core.bll.gluster.GlusterHookSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Detected new hook set-POST-30samba-set.sh.rpmsave in server Host[10.70.37.158], adding to engine hooks >2014-01-30 06:42:34,894 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [511b856] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected new hook set-POST-30samba-set.sh.rpmsave in Cluster test_3. >2014-01-30 06:42:34,894 INFO [org.ovirt.engine.core.bll.gluster.GlusterHookSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Detected new hook set-POST-30samba-set.sh.rpmsave.rpmsave in server Host[10.70.37.158], adding to engine hooks >2014-01-30 06:42:34,899 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [511b856] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected new hook set-POST-30samba-set.sh.rpmsave.rpmsave in Cluster test_3. >2014-01-30 06:42:34,900 INFO [org.ovirt.engine.core.bll.gluster.GlusterHookSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Detected new hook set-POST-30samba-set.sh in server Host[10.70.37.158], adding to engine hooks >2014-01-30 06:42:34,906 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [511b856] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected new hook set-POST-30samba-set.sh in Cluster test_3. >2014-01-30 06:42:34,906 INFO [org.ovirt.engine.core.bll.gluster.GlusterHookSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Detected new hook stop-PRE-29CTDB-teardown.sh.rpmsave.rpmsave in server Host[10.70.37.158], adding to engine hooks >2014-01-30 06:42:34,913 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [511b856] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected new hook stop-PRE-29CTDB-teardown.sh.rpmsave.rpmsave in Cluster test_3. >2014-01-30 06:42:34,913 INFO [org.ovirt.engine.core.bll.gluster.GlusterHookSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Detected new hook stop-PRE-30samba-stop.sh in server Host[10.70.37.158], adding to engine hooks >2014-01-30 06:42:34,920 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [511b856] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected new hook stop-PRE-30samba-stop.sh in Cluster test_3. >2014-01-30 06:42:34,920 INFO [org.ovirt.engine.core.bll.gluster.GlusterHookSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Detected new hook stop-PRE-30samba-stop.sh.rpmsave.rpmsave in server Host[10.70.37.158], adding to engine hooks >2014-01-30 06:42:34,927 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [511b856] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected new hook stop-PRE-30samba-stop.sh.rpmsave.rpmsave in Cluster test_3. >2014-01-30 06:42:34,927 INFO [org.ovirt.engine.core.bll.gluster.GlusterHookSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Detected new hook stop-PRE-29CTDB-teardown.sh.rpmsave in server Host[10.70.37.158], adding to engine hooks >2014-01-30 06:42:34,934 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [511b856] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected new hook stop-PRE-29CTDB-teardown.sh.rpmsave in Cluster test_3. >2014-01-30 06:42:34,934 INFO [org.ovirt.engine.core.bll.gluster.GlusterHookSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Detected new hook stop-PRE-29CTDB-teardown.sh in server Host[10.70.37.158], adding to engine hooks >2014-01-30 06:42:34,941 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [511b856] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected new hook stop-PRE-29CTDB-teardown.sh in Cluster test_3. >2014-01-30 06:42:34,941 INFO [org.ovirt.engine.core.bll.gluster.GlusterHookSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Detected new hook start-POST-30samba-start.sh.rpmsave in server Host[10.70.37.158], adding to engine hooks >2014-01-30 06:42:34,946 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [511b856] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected new hook start-POST-30samba-start.sh.rpmsave in Cluster test_3. >2014-01-30 06:42:34,947 INFO [org.ovirt.engine.core.bll.gluster.GlusterHookSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Detected new hook start-POST-29CTDBsetup.sh.rpmsave.rpmsave in server Host[10.70.37.158], adding to engine hooks >2014-01-30 06:42:34,951 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [511b856] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected new hook start-POST-29CTDBsetup.sh.rpmsave.rpmsave in Cluster test_3. >2014-01-30 06:42:34,952 INFO [org.ovirt.engine.core.bll.gluster.GlusterHookSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Detected new hook start-POST-30samba-start.sh.rpmsave.rpmsave in server Host[10.70.37.158], adding to engine hooks >2014-01-30 06:42:34,957 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [511b856] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected new hook start-POST-30samba-start.sh.rpmsave.rpmsave in Cluster test_3. >2014-01-30 06:42:34,957 INFO [org.ovirt.engine.core.bll.gluster.GlusterHookSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Detected new hook start-POST-29CTDBsetup.sh.rpmsave in server Host[10.70.37.158], adding to engine hooks >2014-01-30 06:42:34,962 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [511b856] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected new hook start-POST-29CTDBsetup.sh.rpmsave in Cluster test_3. >2014-01-30 06:42:34,962 INFO [org.ovirt.engine.core.bll.gluster.GlusterHookSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Detected new hook start-POST-30samba-start.sh in server Host[10.70.37.158], adding to engine hooks >2014-01-30 06:42:34,967 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [511b856] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected new hook start-POST-30samba-start.sh in Cluster test_3. >2014-01-30 06:42:34,967 INFO [org.ovirt.engine.core.bll.gluster.GlusterHookSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Detected new hook start-POST-29CTDBsetup.sh in server Host[10.70.37.158], adding to engine hooks >2014-01-30 06:42:34,972 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [511b856] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected new hook start-POST-29CTDBsetup.sh in Cluster test_3. >2014-01-30 06:42:34,972 INFO [org.ovirt.engine.core.bll.gluster.GlusterHookSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Detected new hook add-brick-PRE-28Quota-enable-root-xattr-heal.sh.rpmsave in server Host[10.70.37.158], adding to engine hooks >2014-01-30 06:42:34,978 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [511b856] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected new hook add-brick-PRE-28Quota-enable-root-xattr-heal.sh.rpmsave in Cluster test_3. >2014-01-30 06:42:34,979 INFO [org.ovirt.engine.core.bll.gluster.GlusterHookSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Detected new hook add-brick-PRE-28Quota-enable-root-xattr-heal.sh.rpmsave.rpmsave in server Host[10.70.37.158], adding to engine hooks >2014-01-30 06:42:34,985 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [511b856] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected new hook add-brick-PRE-28Quota-enable-root-xattr-heal.sh.rpmsave.rpmsave in Cluster test_3. >2014-01-30 06:42:34,985 INFO [org.ovirt.engine.core.bll.gluster.GlusterHookSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Detected new hook add-brick-PRE-28Quota-enable-root-xattr-heal.sh in server Host[10.70.37.158], adding to engine hooks >2014-01-30 06:42:34,991 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [511b856] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected new hook add-brick-PRE-28Quota-enable-root-xattr-heal.sh in Cluster test_3. >2014-01-30 06:42:34,991 INFO [org.ovirt.engine.core.bll.gluster.GlusterHookSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Detected new hook gsync-create-POST-56glusterd-geo-rep-create-post.sh in server Host[10.70.37.158], adding to engine hooks >2014-01-30 06:42:34,996 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [511b856] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected new hook gsync-create-POST-56glusterd-geo-rep-create-post.sh in Cluster test_3. >2014-01-30 06:42:35,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-36) [511b856] START, GetGlusterHookContentVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6934cde4 >2014-01-30 06:42:35,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-19) [511b856] START, GetGlusterHookContentVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 143be8dc >2014-01-30 06:42:35,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-46) [511b856] START, GetGlusterHookContentVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 143be8dc >2014-01-30 06:42:35,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-8) [511b856] START, GetGlusterHookContentVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4f8a68b0 >2014-01-30 06:42:35,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-42) [511b856] START, GetGlusterHookContentVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 9b969b2 >2014-01-30 06:42:35,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-17) [511b856] START, GetGlusterHookContentVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 180e93fe >2014-01-30 06:42:35,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-41) [511b856] START, GetGlusterHookContentVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 35f7af30 >2014-01-30 06:42:35,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-7) [511b856] START, GetGlusterHookContentVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 415cd646 >2014-01-30 06:42:35,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-50) [511b856] START, GetGlusterHookContentVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1f0d891b >2014-01-30 06:42:35,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-48) [511b856] START, GetGlusterHookContentVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6de6dc78 >2014-01-30 06:42:35,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-33) [511b856] START, GetGlusterHookContentVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 686fee58 >2014-01-30 06:42:35,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-30) [511b856] START, GetGlusterHookContentVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ad5f868 >2014-01-30 06:42:35,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-27) [511b856] START, GetGlusterHookContentVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 73970d3b >2014-01-30 06:42:35,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-26) [511b856] START, GetGlusterHookContentVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7921e041 >2014-01-30 06:42:35,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-31) [511b856] START, GetGlusterHookContentVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 42b3f7e2 >2014-01-30 06:42:35,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-25) [511b856] START, GetGlusterHookContentVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 647202fb >2014-01-30 06:42:35,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-45) [511b856] START, GetGlusterHookContentVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 720585b8 >2014-01-30 06:42:35,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-37) [511b856] START, GetGlusterHookContentVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 22df4c3a >2014-01-30 06:42:35,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-19) [511b856] FINISH, GetGlusterHookContentVDSCommand, return: IyEgL2Jpbi9iYXNoCiNub24tcG9ydGFibGUgLSBSSFMtMi4wIG9ubHkKU01CX0NPTkY9L2V0Yy9zYW1iYS9zbWIuY29uZgoKQ1REQl9NTlQ9L2dsdXN0ZXIvbG9jawpQUk9HTkFNRT0iY3RkYiIKT1BUU1BFQz0idm9sbmFtZToiClZPTD0KIyAkTUVUQSBpcyB0aGUgdm9sdW1lIHRoYXQgd2lsbCBiZSB1c2VkIGJ5IENUREIgYXMgYSBzaGFyZWQgZmlsZXN5c3RlbS4KIyBJdCBpcyBub3QgZGVzaXJhYmxlIHRvIHVzZSB0aGlzIHZvbHVtZSBmb3Igc3RvcmluZyAnZGF0YScgYXMgd2VsbC4KIyBNRVRBIGlzIHNldCB0byAnYWxsJyAodml6LiBhIGtleXdvcmQgYW5kIGhlbmNlIG5vdCBhIGxlZ2FsIHZvbHVtZSBuYW1lKQojIHRvIHByZXZlbnQgdGhlIHNjcmlwdCBmcm9tIHJ1bm5pbmcgZm9yIHZvbHVtZXMgaXQgd2FzIG5vdCBpbnRlbmRlZC4KIyBVc2VyIG5lZWRzIHRvIHNldCBNRVRBIHRvIHRoZSB2b2x1bWUgdGhhdCBzZXJ2ZXMgQ1REQiBsb2NrZmlsZS4KTUVUQT0iYWxsIgoKZnVuY3Rpb24gc2lnaHVwX3NhbWJhICgpIHsKICAgICAgICBwaWQ9YGNhdCAvdmFyL3J1bi9zbWJkLnBpZGAKICAgICAgICBpZiBbICIkcGlkIiAhPSAiIiBdCiAgICAgICAgdGhlbgogICAgICAgICAgICAgICAga2lsbCAtSFVQICRwaWQ7CiAgICAgICAgZWxzZQogICAgICAgICAgICAgICAgL2V0Yy9pbml0LmQvc21iIHN0YXJ0CiAgICAgICAgZmkKfQoKZnVuY3Rpb24gcGFyc2VfYXJncyAoKSB7CiAgICAgICAgQVJHUz0kKGdldG9wdCAtbCAkT1BUU1BFQyAgLW5hbWUgJFBST0dOQU1FICRAKQogICAgICAgIGV2YWwgc2V0IC0tICIkQVJHUyIKCiAgICAgICAgd2hpbGUgdHJ1ZTsgZG8KICAgICAgICAgICAgY2FzZSAkMSBpbgogICAgICAgICAgICAgICAgLS12b2xuYW1lKQogICAgICAgICAgICAgICAgICAgIHNoaWZ0CiAgICAgICAgICAgICAgICAgICAgVk9MPSQxCiAgICAgICAgICAgICAgICA7OwoKICAgICAgICAgICAgICAgICopCiAgICAgICAgICAgICAgICAgICAgIHNoaWZ0CiAgICAgICAgICAgICAgICAgICAgIGJyZWFrCiAgICAgICAgICAgICAgICA7OwoKICAgICAgICAgICAgZXNhYwoKICAgICAgICAgICAgc2hpZnQKICAgICAgICBkb25lCn0KCgpmdW5jdGlvbiByZW1vdmVfY3RkYl9vcHRpb25zICgpIHsKICAgICAgICBJRlM9JCdcbicKICAgICAgICBHTFVTVEVSX0NUREJfQ09ORklHPSQnIyBjdGRiIGNvbmZpZyBmb3IgZ2x1c3RlcmZzXG5cdGNsdXN0ZXJpbmcgPSB5ZXNcblx0aWRtYXAgYmFja2VuZCA9IHRkYjJcbicKCiAgICAgICAgZm9yIGxpbmUgaW4gJEdMVVNURVJfQ1REQl9DT05GSUcKICAgICAgICBkbwogICAgICAgICAgICAgICAgc2VkIC1pIC8iJGxpbmUiL2QgJFNNQl9DT05GCiAgICAgICAgZG9uZQogICAgICAgIHVuc2V0IElGUwp9CgpmdW5jdGlvbiByZW1vdmVfZnN0YWJfZW50cnkgKCkgewoJdm9sbmFtZT0kMQoJbW50cHQ9JDIKCW1udGVudD0iYGhvc3RuYW1lYDovJHZvbG5hbWUgJG1udHB0IGdsdXN0ZXJmcyBkZWZhdWx0cyx0cmFuc3BvcnQ9dGNwIDAgMCIKCWVzY19tbnRlbnQ9JChlY2hvIC1lICIkbW50ZW50IiB8IHNlZCAncy9cLy9cXFwvL2cnKQoJZXhpc3RzPWBncmVwICJeJG1udGVudCIgL2V0Yy9mc3RhYmAKCWlmIFsgIiRleGlzdHMiICE9ICIgIiBdCgl0aGVuCgkJc2VkIC1pIC8iJGVzY19tbnRlbnQiL2QgL2V0Yy9mc3RhYgoJZmkKfQoKcGFyc2VfYXJncyAkQAppZiBbICIkTUVUQSIgPSAiJFZPTCIgXQp0aGVuCiAgICAgICAgdW1vdW50ICIkQ1REQl9NTlQiCiAgICAgICAgY2hrY29uZmlnIGN0ZGIgb2ZmCglyZW1vdmVfZnN0YWJfZW50cnkgJFZPTCAkQ1REQl9NTlQKICAgICAgICByZW1vdmVfY3RkYl9vcHRpb25zCiAgICAgICAgc2lnaHVwX3NhbWJhCmZpCg==, log id: 143be8dc >2014-01-30 06:42:35,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-36) [511b856] FINISH, GetGlusterHookContentVDSCommand, return: IyEvYmluL2Jhc2gKCiNUaGUgcHJlZmVycmVkIHdheSBvZiBjcmVhdGluZyBhIHNtYiBzaGFyZSBvZiBhIGdsdXN0ZXIgdm9sdW1lIGhhcyBjaGFuZ2VkLgojVGhlIG9sZCBtZXRob2Qgd2FzIHRvIGNyZWF0ZSBhIGZ1c2UgbW91bnQgb2YgdGhlIHZvbHVtZSBhbmQgc2hhcmUgdGhlIG1vdW50CiNwb2ludCB0aHJvdWdoIHNhbWJhLgojCiNOZXcgbWV0aG9kIGVsaW1pbmF0ZXMgdGhlIHJlcXVpcmVtZW50IG9mIGZ1c2UgbW91bnQgYW5kIGNoYW5nZXMgaW4gZnN0YWIuCiNnbHVzdGVyZnNfdmZzIHBsdWdpbiBmb3Igc2FtYmEgbWFrZXMgY2FsbCB0byBsaWJnZmFwaSB0byBhY2Nlc3MgdGhlIHZvbHVtZS4KIwojVGhpcyBob29rIHNjcmlwdCBlbmFibGVzIHVzZXIgdG8gZW5hYmxlIG9yIGRpc2FibGUgc21iIHNoYXJlIGJ5IHZvbHVtZSBzZXQKI29wdGlvbi4gS2V5cyAidXNlci5jaWZzIiBhbmQgInVzZXIuc21iIiBib3RoIGFyZSB2YWxpZCwgYnV0IHVzZXIuc21iIGlzCiNwcmVmZXJyZWQuCgoKUFJPR05BTUU9IlNzYW1iYS1zZXQiCk9QVFNQRUM9InZvbG5hbWU6IgpWT0w9CgplbmFibGVfc21iPSIiCgpmdW5jdGlvbiBwYXJzZV9hcmdzICgpIHsKICAgICAgICBBUkdTPSQoZ2V0b3B0IC1sICRPUFRTUEVDICAtbyAibyIgLW5hbWUgJFBST0dOQU1FICRAKQogICAgICAgIGV2YWwgc2V0IC0tICIkQVJHUyIKCiAgICAgICAgd2hpbGUgdHJ1ZTsgZG8KICAgICAgICAgICAgY2FzZSAkMSBpbgogICAgICAgICAgICAtLXZvbG5hbWUpCiAgICAgICAgICAgICAgICBzaGlmdAogICAgICAgICAgICAgICAgVk9MPSQxCiAgICAgICAgICAgICAgICA7OwogICAgICAgICAgICAqKQogICAgICAgICAgICAgICAgc2hpZnQKICAgICAgICAgICAgICAgIGZvciBwYWlyIGluICRAOyBkbwogICAgICAgICAgICAgICAgICAgICAgICByZWFkIGtleSB2YWx1ZSA8IDwoZWNobyAiJHBhaXIiIHwgdHIgIj0iICIgIikKICAgICAgICAgICAgICAgICAgICAgICAgY2FzZSAiJGtleSIgaW4KICAgICAgICAgICAgICAgICAgICAgICAgICAgICJ1c2VyLmNpZnMiKQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBlbmFibGVfc21iPSR2YWx1ZQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICA7OwogICAgICAgICAgICAgICAgICAgICAgICAgICAgInVzZXIuc21iIikKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZW5hYmxlX3NtYj0kdmFsdWUKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgOzsKICAgICAgICAgICAgICAgICAgICAgICAgICAgICopCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIDs7CiAgICAgICAgICAgICAgICAgICAgICAgIGVzYWMKICAgICAgICAgICAgICAgIGRvbmUKCiAgICAgICAgICAgICAgICBzaGlmdAogICAgICAgICAgICAgICAgYnJlYWsKICAgICAgICAgICAgICAgIDs7CiAgICAgICAgICAgIGVzYWMKICAgICAgICAgICAgc2hpZnQKICAgICAgICBkb25lCn0KCmZ1bmN0aW9uIGFkZF9zYW1iYV9zaGFyZSAoKSB7CiAgICAgICAgdm9sbmFtZT0kMQogICAgICAgIFNUUklORz0iXG5bZ2x1c3Rlci0kdm9sbmFtZV1cbiIKICAgICAgICBTVFJJTkcrPSJjb21tZW50ID0gRm9yIHNhbWJhIHNoYXJlIG9mIHZvbHVtZSAkdm9sbmFtZVxuIgogICAgICAgIFNUUklORys9InZmcyBvYmplY3RzID0gZ2x1c3RlcmZzXG4iCiAgICAgICAgU1RSSU5HKz0iZ2x1c3RlcmZzOnZvbHVtZSA9ICR2b2xuYW1lXG4iCiAgICAgICAgU1RSSU5HKz0iZ2x1c3RlcmZzOmxvZ2ZpbGUgPSAvdmFyL2xvZy9zYW1iYS9nbHVzdGVyZnMtJHZvbG5hbWUuJSVNLmxvZ1xuIgogICAgICAgIFNUUklORys9ImdsdXN0ZXJmczpsb2dsZXZlbCA9IDdcbiIKICAgICAgICBTVFJJTkcrPSJwYXRoID0gL1xuIgogICAgICAgIFNUUklORys9InJlYWQgb25seSA9IG5vXG4iCiAgICAgICAgU1RSSU5HKz0iZ3Vlc3Qgb2sgPSB5ZXNcbiIKICAgICAgICBwcmludGYgIiRTVFJJTkciICA+PiAvZXRjL3NhbWJhL3NtYi5jb25mCn0KCmZ1bmN0aW9uIHNpZ2h1cF9zYW1iYSAoKSB7CiAgICAgICAgcGlkPWBjYXQgL3Zhci9ydW4vc21iZC5waWRgCiAgICAgICAgaWYgWyAieCRwaWQiICE9ICJ4IiBdCiAgICAgICAgdGhlbgogICAgICAgICAgICAgICAga2lsbCAtSFVQICIkcGlkIjsKICAgICAgICBlbHNlCiAgICAgICAgICAgICAgICAvZXRjL2luaXQuZC9zbWIgc3RhcnQKICAgICAgICBmaQp9CgpmdW5jdGlvbiBkZWxfc2FtYmFfc2hhcmUgKCkgewogICAgICAgIHZvbG5hbWU9JDEKICAgICAgICBzZWQgLWkgIi9cW2dsdXN0ZXItJHZvbG5hbWVcXS8sL14kL2QiIC9ldGMvc2FtYmEvc21iLmNvbmYKfQoKZnVuY3Rpb24gaXNfdm9sdW1lX3N0YXJ0ZWQgKCkgewogICAgICAgIHZvbG5hbWU9JDEKICAgICAgICBlY2hvICIkKGdyZXAgc3RhdHVzIC92YXIvbGliL2dsdXN0ZXJkL3ZvbHMvIiR2b2xuYW1lIi9pbmZvIHxcCiAgICAgICAgICAgICAgICBjdXQgLWQiPSIgLWYyKSIKfQoKcGFyc2VfYXJncyAkQAppZiBbICIwIiA9ICQoaXNfdm9sdW1lX3N0YXJ0ZWQgIiRWT0wiKSBdOyB0aGVuCiAgICBleGl0IDAKZmkKCmlmIFsgIiRlbmFibGVfc21iIiA9ICJlbmFibGUiIF07IHRoZW4KICAgIGlmICEgZ3JlcCAtLXF1aWV0ICJcW2dsdXN0ZXItJFZPTFxdIiAvZXRjL3NhbWJhL3NtYi5jb25mIDsgdGhlbgogICAgICAgIGFkZF9zYW1iYV9zaGFyZSAkVk9MCiAgICAgICAgc2lnaHVwX3NhbWJhCiAgICBmaQoKZWxpZiBbICIkZW5hYmxlX3NtYiIgPSAiZGlzYWJsZSIgXTsgdGhlbgogICAgZGVsX3NhbWJhX3NoYXJlICRWT0wKICAgIHNpZ2h1cF9zYW1iYQpmaQo=, log id: 6934cde4 >2014-01-30 06:42:35,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-46) [511b856] FINISH, GetGlusterHookContentVDSCommand, return: IyEvYmluL2Jhc2gKCiNUaGUgcHJlZmVycmVkIHdheSBvZiBjcmVhdGluZyBhIHNtYiBzaGFyZSBvZiBhIGdsdXN0ZXIgdm9sdW1lIGhhcyBjaGFuZ2VkLgojVGhlIG9sZCBtZXRob2Qgd2FzIHRvIGNyZWF0ZSBhIGZ1c2UgbW91bnQgb2YgdGhlIHZvbHVtZSBhbmQgc2hhcmUgdGhlIG1vdW50CiNwb2ludCB0aHJvdWdoIHNhbWJhLgojCiNOZXcgbWV0aG9kIGVsaW1pbmF0ZXMgdGhlIHJlcXVpcmVtZW50IG9mIGZ1c2UgbW91bnQgYW5kIGNoYW5nZXMgaW4gZnN0YWIuCiNnbHVzdGVyZnNfdmZzIHBsdWdpbiBmb3Igc2FtYmEgbWFrZXMgY2FsbCB0byBsaWJnZmFwaSB0byBhY2Nlc3MgdGhlIHZvbHVtZS4KIwojVGhpcyBob29rIHNjcmlwdCBlbmFibGVzIHVzZXIgdG8gZW5hYmxlIG9yIGRpc2FibGUgc21iIHNoYXJlIGJ5IHZvbHVtZSBzZXQKI29wdGlvbi4gS2V5cyAidXNlci5jaWZzIiBhbmQgInVzZXIuc21iIiBib3RoIGFyZSB2YWxpZCwgYnV0IHVzZXIuc21iIGlzCiNwcmVmZXJyZWQuCgoKUFJPR05BTUU9IlNzYW1iYS1zZXQiCk9QVFNQRUM9InZvbG5hbWU6IgpWT0w9CgplbmFibGVfc21iPSIiCgpmdW5jdGlvbiBwYXJzZV9hcmdzICgpIHsKICAgICAgICBBUkdTPSQoZ2V0b3B0IC1sICRPUFRTUEVDICAtbyAibyIgLW5hbWUgJFBST0dOQU1FICRAKQogICAgICAgIGV2YWwgc2V0IC0tICIkQVJHUyIKCiAgICAgICAgd2hpbGUgdHJ1ZTsgZG8KICAgICAgICAgICAgY2FzZSAkMSBpbgogICAgICAgICAgICAtLXZvbG5hbWUpCiAgICAgICAgICAgICAgICBzaGlmdAogICAgICAgICAgICAgICAgVk9MPSQxCiAgICAgICAgICAgICAgICA7OwogICAgICAgICAgICAqKQogICAgICAgICAgICAgICAgc2hpZnQKICAgICAgICAgICAgICAgIGZvciBwYWlyIGluICRAOyBkbwogICAgICAgICAgICAgICAgICAgICAgICByZWFkIGtleSB2YWx1ZSA8IDwoZWNobyAiJHBhaXIiIHwgdHIgIj0iICIgIikKICAgICAgICAgICAgICAgICAgICAgICAgY2FzZSAiJGtleSIgaW4KICAgICAgICAgICAgICAgICAgICAgICAgICAgICJ1c2VyLmNpZnMiKQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBlbmFibGVfc21iPSR2YWx1ZQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICA7OwogICAgICAgICAgICAgICAgICAgICAgICAgICAgInVzZXIuc21iIikKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZW5hYmxlX3NtYj0kdmFsdWUKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgOzsKICAgICAgICAgICAgICAgICAgICAgICAgICAgICopCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIDs7CiAgICAgICAgICAgICAgICAgICAgICAgIGVzYWMKICAgICAgICAgICAgICAgIGRvbmUKCiAgICAgICAgICAgICAgICBzaGlmdAogICAgICAgICAgICAgICAgYnJlYWsKICAgICAgICAgICAgICAgIDs7CiAgICAgICAgICAgIGVzYWMKICAgICAgICAgICAgc2hpZnQKICAgICAgICBkb25lCn0KCmZ1bmN0aW9uIGFkZF9zYW1iYV9zaGFyZSAoKSB7CiAgICAgICAgdm9sbmFtZT0kMQogICAgICAgIFNUUklORz0iXG5bZ2x1c3Rlci0kdm9sbmFtZV1cbiIKICAgICAgICBTVFJJTkcrPSJjb21tZW50ID0gRm9yIHNhbWJhIHNoYXJlIG9mIHZvbHVtZSAkdm9sbmFtZVxuIgogICAgICAgIFNUUklORys9InZmcyBvYmplY3RzID0gZ2x1c3RlcmZzXG4iCiAgICAgICAgU1RSSU5HKz0iZ2x1c3RlcmZzOnZvbHVtZSA9ICR2b2xuYW1lXG4iCiAgICAgICAgU1RSSU5HKz0iZ2x1c3RlcmZzOmxvZ2ZpbGUgPSAvdmFyL2xvZy9zYW1iYS9nbHVzdGVyZnMtJHZvbG5hbWUuJSVNLmxvZ1xuIgogICAgICAgIFNUUklORys9ImdsdXN0ZXJmczpsb2dsZXZlbCA9IDdcbiIKICAgICAgICBTVFJJTkcrPSJwYXRoID0gL1xuIgogICAgICAgIFNUUklORys9InJlYWQgb25seSA9IG5vXG4iCiAgICAgICAgU1RSSU5HKz0iZ3Vlc3Qgb2sgPSB5ZXNcbiIKICAgICAgICBwcmludGYgIiRTVFJJTkciICA+PiAvZXRjL3NhbWJhL3NtYi5jb25mCn0KCmZ1bmN0aW9uIHNpZ2h1cF9zYW1iYSAoKSB7CiAgICAgICAgcGlkPWBjYXQgL3Zhci9ydW4vc21iZC5waWRgCiAgICAgICAgaWYgWyAieCRwaWQiICE9ICJ4IiBdCiAgICAgICAgdGhlbgogICAgICAgICAgICAgICAga2lsbCAtSFVQICIkcGlkIjsKICAgICAgICBlbHNlCiAgICAgICAgICAgICAgICAvZXRjL2luaXQuZC9zbWIgc3RhcnQKICAgICAgICBmaQp9CgpmdW5jdGlvbiBkZWxfc2FtYmFfc2hhcmUgKCkgewogICAgICAgIHZvbG5hbWU9JDEKICAgICAgICBzZWQgLWkgIi9cW2dsdXN0ZXItJHZvbG5hbWVcXS8sL14kL2QiIC9ldGMvc2FtYmEvc21iLmNvbmYKfQoKZnVuY3Rpb24gaXNfdm9sdW1lX3N0YXJ0ZWQgKCkgewogICAgICAgIHZvbG5hbWU9JDEKICAgICAgICBlY2hvICIkKGdyZXAgc3RhdHVzIC92YXIvbGliL2dsdXN0ZXJkL3ZvbHMvIiR2b2xuYW1lIi9pbmZvIHxcCiAgICAgICAgICAgICAgICBjdXQgLWQiPSIgLWYyKSIKfQoKcGFyc2VfYXJncyAkQAppZiBbICIwIiA9ICQoaXNfdm9sdW1lX3N0YXJ0ZWQgIiRWT0wiKSBdOyB0aGVuCiAgICBleGl0IDAKZmkKCmlmIFsgIiRlbmFibGVfc21iIiA9ICJlbmFibGUiIF07IHRoZW4KICAgIGlmICEgZ3JlcCAtLXF1aWV0ICJcW2dsdXN0ZXItJFZPTFxdIiAvZXRjL3NhbWJhL3NtYi5jb25mIDsgdGhlbgogICAgICAgIGFkZF9zYW1iYV9zaGFyZSAkVk9MCiAgICAgICAgc2lnaHVwX3NhbWJhCiAgICBmaQoKZWxpZiBbICIkZW5hYmxlX3NtYiIgPSAiZGlzYWJsZSIgXTsgdGhlbgogICAgZGVsX3NhbWJhX3NoYXJlICRWT0wKICAgIHNpZ2h1cF9zYW1iYQpmaQo=, log id: 143be8dc >2014-01-30 06:42:35,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-8) [511b856] FINISH, GetGlusterHookContentVDSCommand, return: IyEgL2Jpbi9iYXNoCgojVGhlIHByZWZlcnJlZCB3YXkgb2YgY3JlYXRpbmcgYSBzbWIgc2hhcmUgb2YgYSBnbHVzdGVyIHZvbHVtZSBoYXMgY2hhbmdlZC4KI1RoZSBvbGQgbWV0aG9kIHdhcyB0byBjcmVhdGUgYSBmdXNlIG1vdW50IG9mIHRoZSB2b2x1bWUgYW5kIHNoYXJlIHRoZSBtb3VudAojcG9pbnQgdGhyb3VnaCBzYW1iYS4KIwojTmV3IG1ldGhvZCBlbGltaW5hdGVzIHRoZSByZXF1aXJlbWVudCBvZiBmdXNlIG1vdW50IGFuZCBjaGFuZ2VzIGluIGZzdGFiLgojZ2x1c3RlcmZzX3ZmcyBwbHVnaW4gZm9yIHNhbWJhIG1ha2VzIGNhbGwgdG8gbGliZ2ZhcGkgdG8gYWNjZXNzIHRoZSB2b2x1bWUuCiMKI1RoaXMgaG9vayBzY3JpcHQgYXV0b21hZ2ljYWxseSByZW1vdmVzIHNoYXJlcyBmb3Igdm9sdW1lIG9uIGV2ZXJ5IHZvbHVtZSBzdG9wCiNldmVudCBieSByZW1vdmluZyB0aGUgdm9sdW1lIHJlbGF0ZWQgZW50cmllcyhpZiBhbnkpIGluIHNtYi5jb25mIGZpbGUuCgpQUk9HTkFNRT0iU3NhbWJhLXN0b3AiCk9QVFNQRUM9InZvbG5hbWU6IgpWT0w9CgpmdW5jdGlvbiBwYXJzZV9hcmdzICgpIHsKICAgICAgICBBUkdTPSQoZ2V0b3B0IC1sICRPUFRTUEVDICAtbmFtZSAkUFJPR05BTUUgJEApCiAgICAgICAgZXZhbCBzZXQgLS0gIiRBUkdTIgoKICAgICAgICB3aGlsZSB0cnVlOyBkbwogICAgICAgIGNhc2UgJDEgaW4KICAgICAgICAtLXZvbG5hbWUpCiAgICAgICAgIHNoaWZ0CiAgICAgICAgIFZPTD0kMQogICAgICAgICA7OwogICAgICAgICopCiAgICAgICAgIHNoaWZ0CiAgICAgICAgIGJyZWFrCiAgICAgICAgIDs7CiAgICAgICAgZXNhYwogICAgICAgIHNoaWZ0CiAgICAgICAgZG9uZQp9CgpmdW5jdGlvbiBkZWxfc2FtYmFfc2hhcmUgKCkgewogICAgICAgIHZvbG5hbWU9JDEKICAgICAgICBzZWQgLWkgIi9cW2dsdXN0ZXItJHZvbG5hbWVcXS8sL14kL2QiIC9ldGMvc2FtYmEvc21iLmNvbmYKfQoKZnVuY3Rpb24gc2lnaHVwX3NhbWJhICgpIHsKICAgICAgICBwaWQ9YGNhdCAvdmFyL3J1bi9zbWJkLnBpZGAKICAgICAgICBpZiBbICJ4JHBpZCIgIT0gIngiIF0KICAgICAgICB0aGVuCiAgICAgICAgICAgICAgICBraWxsIC1IVVAgJHBpZDsKICAgICAgICBlbHNlCiAgICAgICAgICAgICAgICAvZXRjL2luaXQuZC9zbWIgY29uZHJlc3RhcnQKICAgICAgICBmaQp9CgpwYXJzZV9hcmdzICRACmRlbF9zYW1iYV9zaGFyZSAkVk9MCnNpZ2h1cF9zYW1iYQo=, log id: 4f8a68b0 >2014-01-30 06:42:35,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-42) [511b856] FINISH, GetGlusterHookContentVDSCommand, return: IyEvYmluL2Jhc2gKCiNUaGUgcHJlZmVycmVkIHdheSBvZiBjcmVhdGluZyBhIHNtYiBzaGFyZSBvZiBhIGdsdXN0ZXIgdm9sdW1lIGhhcyBjaGFuZ2VkLgojVGhlIG9sZCBtZXRob2Qgd2FzIHRvIGNyZWF0ZSBhIGZ1c2UgbW91bnQgb2YgdGhlIHZvbHVtZSBhbmQgc2hhcmUgdGhlIG1vdW50CiNwb2ludCB0aHJvdWdoIHNhbWJhLgojCiNOZXcgbWV0aG9kIGVsaW1pbmF0ZXMgdGhlIHJlcXVpcmVtZW50IG9mIGZ1c2UgbW91bnQgYW5kIGNoYW5nZXMgaW4gZnN0YWIuCiNnbHVzdGVyZnNfdmZzIHBsdWdpbiBmb3Igc2FtYmEgbWFrZXMgY2FsbCB0byBsaWJnZmFwaSB0byBhY2Nlc3MgdGhlIHZvbHVtZS4KIwojVGhpcyBob29rIHNjcmlwdCBlbmFibGVzIHVzZXIgdG8gZW5hYmxlIG9yIGRpc2FibGUgc21iIHNoYXJlIGJ5IHZvbHVtZSBzZXQKI29wdGlvbi4gS2V5cyAidXNlci5jaWZzIiBhbmQgInVzZXIuc21iIiBib3RoIGFyZSB2YWxpZCwgYnV0IHVzZXIuc21iIGlzCiNwcmVmZXJyZWQuCgoKUFJPR05BTUU9IlNzYW1iYS1zZXQiCk9QVFNQRUM9InZvbG5hbWU6IgpWT0w9CgplbmFibGVfc21iPSIiCgpmdW5jdGlvbiBwYXJzZV9hcmdzICgpIHsKICAgICAgICBBUkdTPSQoZ2V0b3B0IC1sICRPUFRTUEVDICAtbyAibyIgLW5hbWUgJFBST0dOQU1FICRAKQogICAgICAgIGV2YWwgc2V0IC0tICIkQVJHUyIKCiAgICAgICAgd2hpbGUgdHJ1ZTsgZG8KICAgICAgICAgICAgY2FzZSAkMSBpbgogICAgICAgICAgICAtLXZvbG5hbWUpCiAgICAgICAgICAgICAgICBzaGlmdAogICAgICAgICAgICAgICAgVk9MPSQxCiAgICAgICAgICAgICAgICA7OwogICAgICAgICAgICAqKQogICAgICAgICAgICAgICAgc2hpZnQKICAgICAgICAgICAgICAgIGZvciBwYWlyIGluICRAOyBkbwogICAgICAgICAgICAgICAgICAgICAgICByZWFkIGtleSB2YWx1ZSA8IDwoZWNobyAiJHBhaXIiIHwgdHIgIj0iICIgIikKICAgICAgICAgICAgICAgICAgICAgICAgY2FzZSAiJGtleSIgaW4KICAgICAgICAgICAgICAgICAgICAgICAgICAgICJ1c2VyLmNpZnMiKQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBlbmFibGVfc21iPSR2YWx1ZQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICA7OwogICAgICAgICAgICAgICAgICAgICAgICAgICAgInVzZXIuc21iIikKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZW5hYmxlX3NtYj0kdmFsdWUKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgOzsKICAgICAgICAgICAgICAgICAgICAgICAgICAgICopCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIDs7CiAgICAgICAgICAgICAgICAgICAgICAgIGVzYWMKICAgICAgICAgICAgICAgIGRvbmUKCiAgICAgICAgICAgICAgICBzaGlmdAogICAgICAgICAgICAgICAgYnJlYWsKICAgICAgICAgICAgICAgIDs7CiAgICAgICAgICAgIGVzYWMKICAgICAgICAgICAgc2hpZnQKICAgICAgICBkb25lCn0KCmZ1bmN0aW9uIGFkZF9zYW1iYV9zaGFyZSAoKSB7CiAgICAgICAgdm9sbmFtZT0kMQogICAgICAgIFNUUklORz0iXG5bZ2x1c3Rlci0kdm9sbmFtZV1cbiIKICAgICAgICBTVFJJTkcrPSJjb21tZW50ID0gRm9yIHNhbWJhIHNoYXJlIG9mIHZvbHVtZSAkdm9sbmFtZVxuIgogICAgICAgIFNUUklORys9InZmcyBvYmplY3RzID0gZ2x1c3RlcmZzXG4iCiAgICAgICAgU1RSSU5HKz0iZ2x1c3RlcmZzOnZvbHVtZSA9ICR2b2xuYW1lXG4iCiAgICAgICAgU1RSSU5HKz0iZ2x1c3RlcmZzOmxvZ2ZpbGUgPSAvdmFyL2xvZy9zYW1iYS9nbHVzdGVyZnMtJHZvbG5hbWUuJSVNLmxvZ1xuIgogICAgICAgIFNUUklORys9ImdsdXN0ZXJmczpsb2dsZXZlbCA9IDdcbiIKICAgICAgICBTVFJJTkcrPSJwYXRoID0gL1xuIgogICAgICAgIFNUUklORys9InJlYWQgb25seSA9IG5vXG4iCiAgICAgICAgU1RSSU5HKz0iZ3Vlc3Qgb2sgPSB5ZXNcbiIKICAgICAgICBwcmludGYgIiRTVFJJTkciICA+PiAvZXRjL3NhbWJhL3NtYi5jb25mCn0KCmZ1bmN0aW9uIHNpZ2h1cF9zYW1iYSAoKSB7CiAgICAgICAgcGlkPWBjYXQgL3Zhci9ydW4vc21iZC5waWRgCiAgICAgICAgaWYgWyAieCRwaWQiICE9ICJ4IiBdCiAgICAgICAgdGhlbgogICAgICAgICAgICAgICAga2lsbCAtSFVQICIkcGlkIjsKICAgICAgICBlbHNlCiAgICAgICAgICAgICAgICAvZXRjL2luaXQuZC9zbWIgc3RhcnQKICAgICAgICBmaQp9CgpmdW5jdGlvbiBkZWxfc2FtYmFfc2hhcmUgKCkgewogICAgICAgIHZvbG5hbWU9JDEKICAgICAgICBzZWQgLWkgIi9cW2dsdXN0ZXItJHZvbG5hbWVcXS8sL14kL2QiIC9ldGMvc2FtYmEvc21iLmNvbmYKfQoKZnVuY3Rpb24gaXNfdm9sdW1lX3N0YXJ0ZWQgKCkgewogICAgICAgIHZvbG5hbWU9JDEKICAgICAgICBlY2hvICIkKGdyZXAgc3RhdHVzIC92YXIvbGliL2dsdXN0ZXJkL3ZvbHMvIiR2b2xuYW1lIi9pbmZvIHxcCiAgICAgICAgICAgICAgICBjdXQgLWQiPSIgLWYyKSIKfQoKcGFyc2VfYXJncyAkQAppZiBbICIwIiA9ICQoaXNfdm9sdW1lX3N0YXJ0ZWQgIiRWT0wiKSBdOyB0aGVuCiAgICBleGl0IDAKZmkKCmlmIFsgIiRlbmFibGVfc21iIiA9ICJlbmFibGUiIF07IHRoZW4KICAgIGlmICEgZ3JlcCAtLXF1aWV0ICJcW2dsdXN0ZXItJFZPTFxdIiAvZXRjL3NhbWJhL3NtYi5jb25mIDsgdGhlbgogICAgICAgIGFkZF9zYW1iYV9zaGFyZSAkVk9MCiAgICAgICAgc2lnaHVwX3NhbWJhCiAgICBmaQoKZWxpZiBbICIkZW5hYmxlX3NtYiIgPSAiZGlzYWJsZSIgXTsgdGhlbgogICAgZGVsX3NhbWJhX3NoYXJlICRWT0wKICAgIHNpZ2h1cF9zYW1iYQpmaQo=, log id: 9b969b2 >2014-01-30 06:42:35,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-17) [511b856] FINISH, GetGlusterHookContentVDSCommand, return: IyEgL2Jpbi9iYXNoCiMgUkhTLTIuMCBvbmx5CiMgLSBUaGUgc2NyaXB0IG1vdW50cyB0aGUgJ21ldGEtdm9sJyBvbiBzdGFydCAnZXZlbnQnIG9uIGEga25vd24KIyAgIGRpcmVjdG9yeSAoZWcuIC9nbHVzdGVyL2xvY2spCiMgLSBBZGRzIHRoZSBuZWNlc3NhcnkgY29uZmlndXJhdGlvbiBjaGFuZ2VzIGZvciBjdGRiIGluIHNtYi5jb25mIGFuZAojICAgcmVzdGFydHMgc21iIHNlcnZpY2UuCiMgLSBQLlM6IFRoZXJlIGFyZSBvdGhlciAndGFza3MnIHRoYXQgbmVlZCB0byBiZSBkb25lIG91dHNpZGUgdGhpcyBzY3JpcHQKIyAgIHRvIGdldCBDVERCIGJhc2VkIGZhaWxvdmVyIHVwIGFuZCBydW5uaW5nLgoKU01CX0NPTkY9L2V0Yy9zYW1iYS9zbWIuY29uZgoKQ1REQl9NTlQ9L2dsdXN0ZXIvbG9jawpQUk9HTkFNRT0iY3RkYiIKT1BUU1BFQz0idm9sbmFtZToiClZPTD0KIyAkTUVUQSBpcyB0aGUgdm9sdW1lIHRoYXQgd2lsbCBiZSB1c2VkIGJ5IENUREIgYXMgYSBzaGFyZWQgZmlsZXN5c3RlbS4KIyBJdCBpcyBub3QgZGVzaXJhYmxlIHRvIHVzZSB0aGlzIHZvbHVtZSBmb3Igc3RvcmluZyAnZGF0YScgYXMgd2VsbC4KIyBNRVRBIGlzIHNldCB0byAnYWxsJyAodml6LiBhIGtleXdvcmQgYW5kIGhlbmNlIG5vdCBhIGxlZ2FsIHZvbHVtZSBuYW1lKQojIHRvIHByZXZlbnQgdGhlIHNjcmlwdCBmcm9tIHJ1bm5pbmcgZm9yIHZvbHVtZXMgaXQgd2FzIG5vdCBpbnRlbmRlZC4KIyBVc2VyIG5lZWRzIHRvIHNldCBNRVRBIHRvIHRoZSB2b2x1bWUgdGhhdCBzZXJ2ZXMgQ1REQiBsb2NrZmlsZS4KTUVUQT0iYWxsIgoKZnVuY3Rpb24gcGFyc2VfYXJncyAoKSB7CiAgICAgICAgQVJHUz0kKGdldG9wdCAtbCAkT1BUU1BFQyAgLW5hbWUgJFBST0dOQU1FICRAKQogICAgICAgIGV2YWwgc2V0IC0tICIkQVJHUyIKCiAgICAgICAgd2hpbGUgdHJ1ZTsgZG8KICAgICAgICAgICAgY2FzZSAkMSBpbgogICAgICAgICAgICAgICAgLS12b2xuYW1lKQogICAgICAgICAgICAgICAgICAgIHNoaWZ0CiAgICAgICAgICAgICAgICAgICAgVk9MPSQxCiAgICAgICAgICAgICAgICA7OwoKICAgICAgICAgICAgICAgICopCiAgICAgICAgICAgICAgICAgICAgIHNoaWZ0CiAgICAgICAgICAgICAgICAgICAgIGJyZWFrCiAgICAgICAgICAgICAgICA7OwoKICAgICAgICAgICAgZXNhYwoKICAgICAgICAgICAgc2hpZnQKICAgICAgICBkb25lCn0KCmZ1bmN0aW9uIGFkZF9nbHVzdGVyZnNfY3RkYl9vcHRpb25zICgpIHsKICAgICAgICBQQVQ9IlNoYXJlIERlZmluaXRpb25zIgogICAgICAgIEdMVVNURVJfQ1REQl9DT05GSUc9IiMgY3RkYiBjb25maWcgZm9yIGdsdXN0ZXJmc1xuXHRjbHVzdGVyaW5nID0geWVzXG5cdGlkbWFwIGJhY2tlbmQgPSB0ZGIyXG4iCiAgICAgICAgZXhpc3RzPWBncmVwICJjbHVzdGVyaW5nID0geWVzIiAiJFNNQl9DT05GImAKICAgICAgICBpZiBbICIkZXhpc3RzIiA9PSAiIiBdCiAgICAgICAgdGhlbgogICAgICAgICAgICBzZWQgLWkgLyIkUEFUIi9pXCAiJEdMVVNURVJfQ1REQl9DT05GSUciICIkU01CX0NPTkYiCiAgICAgICAgZmkKfQoKZnVuY3Rpb24gYWRkX2ZzdGFiX2VudHJ5ICgpIHsKICAgICAgICB2b2xuYW1lPSQxCiAgICAgICAgbW50cHQ9JDIKICAgICAgICBtbnRlbnQ9ImBob3N0bmFtZWA6LyR2b2xuYW1lICRtbnRwdCBnbHVzdGVyZnMgZGVmYXVsdHMsdHJhbnNwb3J0PXRjcCAwIDAiCiAgICAgICAgZXhpc3RzPWBncmVwICJeJG1udGVudCIgL2V0Yy9mc3RhYmAKICAgICAgICBpZiBbICIkZXhpc3RzIiA9PSAiIiBdCiAgICAgICAgdGhlbgogICAgICAgICAgICBlY2hvICIkbW50ZW50IiA+PiAvZXRjL2ZzdGFiCiAgICAgICAgZmkKfQoKcGFyc2VfYXJncyAkQAppZiBbICIkTUVUQSIgPSAiJFZPTCIgXQp0aGVuCiAgICAjZXhwZWN0cyBjdGRiIHNlcnZpY2UgdG8gbWFuYWdlIHNtYgogICAgc2VydmljZSBzbWIgc3RvcAogICAgYWRkX2dsdXN0ZXJmc19jdGRiX29wdGlvbnMKICAgIG1rZGlyIC1wICRDVERCX01OVAogICAgc2xlZXAgNQogICAgbW91bnQgLXQgZ2x1c3RlcmZzIGBob3N0bmFtZWA6JFZPTCAiJENUREJfTU5UIiAmJiBcCiAgICAgICAgYWRkX2ZzdGFiX2VudHJ5ICRWT0wgJENUREJfTU5UCiAgICBjaGtjb25maWcgY3RkYiBvbgpmaQo=, log id: 180e93fe >2014-01-30 06:42:35,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-7) [511b856] FINISH, GetGlusterHookContentVDSCommand, return: IyEgL2Jpbi9iYXNoCiNub24tcG9ydGFibGUgLSBSSFMtMi4wIG9ubHkKU01CX0NPTkY9L2V0Yy9zYW1iYS9zbWIuY29uZgoKQ1REQl9NTlQ9L2dsdXN0ZXIvbG9jawpQUk9HTkFNRT0iY3RkYiIKT1BUU1BFQz0idm9sbmFtZToiClZPTD0KIyAkTUVUQSBpcyB0aGUgdm9sdW1lIHRoYXQgd2lsbCBiZSB1c2VkIGJ5IENUREIgYXMgYSBzaGFyZWQgZmlsZXN5c3RlbS4KIyBJdCBpcyBub3QgZGVzaXJhYmxlIHRvIHVzZSB0aGlzIHZvbHVtZSBmb3Igc3RvcmluZyAnZGF0YScgYXMgd2VsbC4KIyBNRVRBIGlzIHNldCB0byAnYWxsJyAodml6LiBhIGtleXdvcmQgYW5kIGhlbmNlIG5vdCBhIGxlZ2FsIHZvbHVtZSBuYW1lKQojIHRvIHByZXZlbnQgdGhlIHNjcmlwdCBmcm9tIHJ1bm5pbmcgZm9yIHZvbHVtZXMgaXQgd2FzIG5vdCBpbnRlbmRlZC4KIyBVc2VyIG5lZWRzIHRvIHNldCBNRVRBIHRvIHRoZSB2b2x1bWUgdGhhdCBzZXJ2ZXMgQ1REQiBsb2NrZmlsZS4KTUVUQT0iYWxsIgoKZnVuY3Rpb24gc2lnaHVwX3NhbWJhICgpIHsKICAgICAgICBwaWQ9YGNhdCAvdmFyL3J1bi9zbWJkLnBpZGAKICAgICAgICBpZiBbICIkcGlkIiAhPSAiIiBdCiAgICAgICAgdGhlbgogICAgICAgICAgICAgICAga2lsbCAtSFVQICRwaWQ7CiAgICAgICAgZWxzZQogICAgICAgICAgICAgICAgL2V0Yy9pbml0LmQvc21iIHN0YXJ0CiAgICAgICAgZmkKfQoKZnVuY3Rpb24gcGFyc2VfYXJncyAoKSB7CiAgICAgICAgQVJHUz0kKGdldG9wdCAtbCAkT1BUU1BFQyAgLW5hbWUgJFBST0dOQU1FICRAKQogICAgICAgIGV2YWwgc2V0IC0tICIkQVJHUyIKCiAgICAgICAgd2hpbGUgdHJ1ZTsgZG8KICAgICAgICAgICAgY2FzZSAkMSBpbgogICAgICAgICAgICAgICAgLS12b2xuYW1lKQogICAgICAgICAgICAgICAgICAgIHNoaWZ0CiAgICAgICAgICAgICAgICAgICAgVk9MPSQxCiAgICAgICAgICAgICAgICA7OwoKICAgICAgICAgICAgICAgICopCiAgICAgICAgICAgICAgICAgICAgIHNoaWZ0CiAgICAgICAgICAgICAgICAgICAgIGJyZWFrCiAgICAgICAgICAgICAgICA7OwoKICAgICAgICAgICAgZXNhYwoKICAgICAgICAgICAgc2hpZnQKICAgICAgICBkb25lCn0KCgpmdW5jdGlvbiByZW1vdmVfY3RkYl9vcHRpb25zICgpIHsKICAgICAgICBJRlM9JCdcbicKICAgICAgICBHTFVTVEVSX0NUREJfQ09ORklHPSQnIyBjdGRiIGNvbmZpZyBmb3IgZ2x1c3RlcmZzXG5cdGNsdXN0ZXJpbmcgPSB5ZXNcblx0aWRtYXAgYmFja2VuZCA9IHRkYjJcbicKCiAgICAgICAgZm9yIGxpbmUgaW4gJEdMVVNURVJfQ1REQl9DT05GSUcKICAgICAgICBkbwogICAgICAgICAgICAgICAgc2VkIC1pIC8iJGxpbmUiL2QgJFNNQl9DT05GCiAgICAgICAgZG9uZQogICAgICAgIHVuc2V0IElGUwp9CgpmdW5jdGlvbiByZW1vdmVfZnN0YWJfZW50cnkgKCkgewoJdm9sbmFtZT0kMQoJbW50cHQ9JDIKCW1udGVudD0iYGhvc3RuYW1lYDovJHZvbG5hbWUgJG1udHB0IGdsdXN0ZXJmcyBkZWZhdWx0cyx0cmFuc3BvcnQ9dGNwIDAgMCIKCWVzY19tbnRlbnQ9JChlY2hvIC1lICIkbW50ZW50IiB8IHNlZCAncy9cLy9cXFwvL2cnKQoJZXhpc3RzPWBncmVwICJeJG1udGVudCIgL2V0Yy9mc3RhYmAKCWlmIFsgIiRleGlzdHMiICE9ICIgIiBdCgl0aGVuCgkJc2VkIC1pIC8iJGVzY19tbnRlbnQiL2QgL2V0Yy9mc3RhYgoJZmkKfQoKcGFyc2VfYXJncyAkQAppZiBbICIkTUVUQSIgPSAiJFZPTCIgXQp0aGVuCiAgICAgICAgdW1vdW50ICIkQ1REQl9NTlQiCiAgICAgICAgY2hrY29uZmlnIGN0ZGIgb2ZmCglyZW1vdmVfZnN0YWJfZW50cnkgJFZPTCAkQ1REQl9NTlQKICAgICAgICByZW1vdmVfY3RkYl9vcHRpb25zCiAgICAgICAgc2lnaHVwX3NhbWJhCmZpCg==, log id: 415cd646 >2014-01-30 06:42:35,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-41) [511b856] FINISH, GetGlusterHookContentVDSCommand, return: IyEgL2Jpbi9iYXNoCiNub24tcG9ydGFibGUgLSBSSFMtMi4wIG9ubHkKU01CX0NPTkY9L2V0Yy9zYW1iYS9zbWIuY29uZgoKQ1REQl9NTlQ9L2dsdXN0ZXIvbG9jawpQUk9HTkFNRT0iY3RkYiIKT1BUU1BFQz0idm9sbmFtZToiClZPTD0KIyAkTUVUQSBpcyB0aGUgdm9sdW1lIHRoYXQgd2lsbCBiZSB1c2VkIGJ5IENUREIgYXMgYSBzaGFyZWQgZmlsZXN5c3RlbS4KIyBJdCBpcyBub3QgZGVzaXJhYmxlIHRvIHVzZSB0aGlzIHZvbHVtZSBmb3Igc3RvcmluZyAnZGF0YScgYXMgd2VsbC4KIyBNRVRBIGlzIHNldCB0byAnYWxsJyAodml6LiBhIGtleXdvcmQgYW5kIGhlbmNlIG5vdCBhIGxlZ2FsIHZvbHVtZSBuYW1lKQojIHRvIHByZXZlbnQgdGhlIHNjcmlwdCBmcm9tIHJ1bm5pbmcgZm9yIHZvbHVtZXMgaXQgd2FzIG5vdCBpbnRlbmRlZC4KIyBVc2VyIG5lZWRzIHRvIHNldCBNRVRBIHRvIHRoZSB2b2x1bWUgdGhhdCBzZXJ2ZXMgQ1REQiBsb2NrZmlsZS4KTUVUQT0iYWxsIgoKZnVuY3Rpb24gc2lnaHVwX3NhbWJhICgpIHsKICAgICAgICBwaWQ9YGNhdCAvdmFyL3J1bi9zbWJkLnBpZGAKICAgICAgICBpZiBbICIkcGlkIiAhPSAiIiBdCiAgICAgICAgdGhlbgogICAgICAgICAgICAgICAga2lsbCAtSFVQICRwaWQ7CiAgICAgICAgZWxzZQogICAgICAgICAgICAgICAgL2V0Yy9pbml0LmQvc21iIHN0YXJ0CiAgICAgICAgZmkKfQoKZnVuY3Rpb24gcGFyc2VfYXJncyAoKSB7CiAgICAgICAgQVJHUz0kKGdldG9wdCAtbCAkT1BUU1BFQyAgLW5hbWUgJFBST0dOQU1FICRAKQogICAgICAgIGV2YWwgc2V0IC0tICIkQVJHUyIKCiAgICAgICAgd2hpbGUgdHJ1ZTsgZG8KICAgICAgICAgICAgY2FzZSAkMSBpbgogICAgICAgICAgICAgICAgLS12b2xuYW1lKQogICAgICAgICAgICAgICAgICAgIHNoaWZ0CiAgICAgICAgICAgICAgICAgICAgVk9MPSQxCiAgICAgICAgICAgICAgICA7OwoKICAgICAgICAgICAgICAgICopCiAgICAgICAgICAgICAgICAgICAgIHNoaWZ0CiAgICAgICAgICAgICAgICAgICAgIGJyZWFrCiAgICAgICAgICAgICAgICA7OwoKICAgICAgICAgICAgZXNhYwoKICAgICAgICAgICAgc2hpZnQKICAgICAgICBkb25lCn0KCgpmdW5jdGlvbiByZW1vdmVfY3RkYl9vcHRpb25zICgpIHsKICAgICAgICBJRlM9JCdcbicKICAgICAgICBHTFVTVEVSX0NUREJfQ09ORklHPSQnIyBjdGRiIGNvbmZpZyBmb3IgZ2x1c3RlcmZzXG5cdGNsdXN0ZXJpbmcgPSB5ZXNcblx0aWRtYXAgYmFja2VuZCA9IHRkYjJcbicKCiAgICAgICAgZm9yIGxpbmUgaW4gJEdMVVNURVJfQ1REQl9DT05GSUcKICAgICAgICBkbwogICAgICAgICAgICAgICAgc2VkIC1pIC8iJGxpbmUiL2QgJFNNQl9DT05GCiAgICAgICAgZG9uZQogICAgICAgIHVuc2V0IElGUwp9CgpmdW5jdGlvbiByZW1vdmVfZnN0YWJfZW50cnkgKCkgewoJdm9sbmFtZT0kMQoJbW50cHQ9JDIKCW1udGVudD0iYGhvc3RuYW1lYDovJHZvbG5hbWUgJG1udHB0IGdsdXN0ZXJmcyBkZWZhdWx0cyx0cmFuc3BvcnQ9dGNwIDAgMCIKCWVzY19tbnRlbnQ9JChlY2hvIC1lICIkbW50ZW50IiB8IHNlZCAncy9cLy9cXFwvL2cnKQoJZXhpc3RzPWBncmVwICJeJG1udGVudCIgL2V0Yy9mc3RhYmAKCWlmIFsgIiRleGlzdHMiICE9ICIgIiBdCgl0aGVuCgkJc2VkIC1pIC8iJGVzY19tbnRlbnQiL2QgL2V0Yy9mc3RhYgoJZmkKfQoKcGFyc2VfYXJncyAkQAppZiBbICIkTUVUQSIgPSAiJFZPTCIgXQp0aGVuCiAgICAgICAgdW1vdW50ICIkQ1REQl9NTlQiCiAgICAgICAgY2hrY29uZmlnIGN0ZGIgb2ZmCglyZW1vdmVfZnN0YWJfZW50cnkgJFZPTCAkQ1REQl9NTlQKICAgICAgICByZW1vdmVfY3RkYl9vcHRpb25zCiAgICAgICAgc2lnaHVwX3NhbWJhCmZpCg==, log id: 35f7af30 >2014-01-30 06:42:35,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-50) [511b856] FINISH, GetGlusterHookContentVDSCommand, return: IyEgL2Jpbi9iYXNoCiMgUkhTLTIuMCBvbmx5CiMgLSBUaGUgc2NyaXB0IG1vdW50cyB0aGUgJ21ldGEtdm9sJyBvbiBzdGFydCAnZXZlbnQnIG9uIGEga25vd24KIyAgIGRpcmVjdG9yeSAoZWcuIC9nbHVzdGVyL2xvY2spCiMgLSBBZGRzIHRoZSBuZWNlc3NhcnkgY29uZmlndXJhdGlvbiBjaGFuZ2VzIGZvciBjdGRiIGluIHNtYi5jb25mIGFuZAojICAgcmVzdGFydHMgc21iIHNlcnZpY2UuCiMgLSBQLlM6IFRoZXJlIGFyZSBvdGhlciAndGFza3MnIHRoYXQgbmVlZCB0byBiZSBkb25lIG91dHNpZGUgdGhpcyBzY3JpcHQKIyAgIHRvIGdldCBDVERCIGJhc2VkIGZhaWxvdmVyIHVwIGFuZCBydW5uaW5nLgoKU01CX0NPTkY9L2V0Yy9zYW1iYS9zbWIuY29uZgoKQ1REQl9NTlQ9L2dsdXN0ZXIvbG9jawpQUk9HTkFNRT0iY3RkYiIKT1BUU1BFQz0idm9sbmFtZToiClZPTD0KIyAkTUVUQSBpcyB0aGUgdm9sdW1lIHRoYXQgd2lsbCBiZSB1c2VkIGJ5IENUREIgYXMgYSBzaGFyZWQgZmlsZXN5c3RlbS4KIyBJdCBpcyBub3QgZGVzaXJhYmxlIHRvIHVzZSB0aGlzIHZvbHVtZSBmb3Igc3RvcmluZyAnZGF0YScgYXMgd2VsbC4KIyBNRVRBIGlzIHNldCB0byAnYWxsJyAodml6LiBhIGtleXdvcmQgYW5kIGhlbmNlIG5vdCBhIGxlZ2FsIHZvbHVtZSBuYW1lKQojIHRvIHByZXZlbnQgdGhlIHNjcmlwdCBmcm9tIHJ1bm5pbmcgZm9yIHZvbHVtZXMgaXQgd2FzIG5vdCBpbnRlbmRlZC4KIyBVc2VyIG5lZWRzIHRvIHNldCBNRVRBIHRvIHRoZSB2b2x1bWUgdGhhdCBzZXJ2ZXMgQ1REQiBsb2NrZmlsZS4KTUVUQT0iYWxsIgoKZnVuY3Rpb24gcGFyc2VfYXJncyAoKSB7CiAgICAgICAgQVJHUz0kKGdldG9wdCAtbCAkT1BUU1BFQyAgLW5hbWUgJFBST0dOQU1FICRAKQogICAgICAgIGV2YWwgc2V0IC0tICIkQVJHUyIKCiAgICAgICAgd2hpbGUgdHJ1ZTsgZG8KICAgICAgICAgICAgY2FzZSAkMSBpbgogICAgICAgICAgICAgICAgLS12b2xuYW1lKQogICAgICAgICAgICAgICAgICAgIHNoaWZ0CiAgICAgICAgICAgICAgICAgICAgVk9MPSQxCiAgICAgICAgICAgICAgICA7OwoKICAgICAgICAgICAgICAgICopCiAgICAgICAgICAgICAgICAgICAgIHNoaWZ0CiAgICAgICAgICAgICAgICAgICAgIGJyZWFrCiAgICAgICAgICAgICAgICA7OwoKICAgICAgICAgICAgZXNhYwoKICAgICAgICAgICAgc2hpZnQKICAgICAgICBkb25lCn0KCmZ1bmN0aW9uIGFkZF9nbHVzdGVyZnNfY3RkYl9vcHRpb25zICgpIHsKICAgICAgICBQQVQ9IlNoYXJlIERlZmluaXRpb25zIgogICAgICAgIEdMVVNURVJfQ1REQl9DT05GSUc9IiMgY3RkYiBjb25maWcgZm9yIGdsdXN0ZXJmc1xuXHRjbHVzdGVyaW5nID0geWVzXG5cdGlkbWFwIGJhY2tlbmQgPSB0ZGIyXG4iCiAgICAgICAgZXhpc3RzPWBncmVwICJjbHVzdGVyaW5nID0geWVzIiAiJFNNQl9DT05GImAKICAgICAgICBpZiBbICIkZXhpc3RzIiA9PSAiIiBdCiAgICAgICAgdGhlbgogICAgICAgICAgICBzZWQgLWkgLyIkUEFUIi9pXCAiJEdMVVNURVJfQ1REQl9DT05GSUciICIkU01CX0NPTkYiCiAgICAgICAgZmkKfQoKZnVuY3Rpb24gYWRkX2ZzdGFiX2VudHJ5ICgpIHsKICAgICAgICB2b2xuYW1lPSQxCiAgICAgICAgbW50cHQ9JDIKICAgICAgICBtbnRlbnQ9ImBob3N0bmFtZWA6LyR2b2xuYW1lICRtbnRwdCBnbHVzdGVyZnMgZGVmYXVsdHMsdHJhbnNwb3J0PXRjcCAwIDAiCiAgICAgICAgZXhpc3RzPWBncmVwICJeJG1udGVudCIgL2V0Yy9mc3RhYmAKICAgICAgICBpZiBbICIkZXhpc3RzIiA9PSAiIiBdCiAgICAgICAgdGhlbgogICAgICAgICAgICBlY2hvICIkbW50ZW50IiA+PiAvZXRjL2ZzdGFiCiAgICAgICAgZmkKfQoKcGFyc2VfYXJncyAkQAppZiBbICIkTUVUQSIgPSAiJFZPTCIgXQp0aGVuCiAgICAjZXhwZWN0cyBjdGRiIHNlcnZpY2UgdG8gbWFuYWdlIHNtYgogICAgc2VydmljZSBzbWIgc3RvcAogICAgYWRkX2dsdXN0ZXJmc19jdGRiX29wdGlvbnMKICAgIG1rZGlyIC1wICRDVERCX01OVAogICAgc2xlZXAgNQogICAgbW91bnQgLXQgZ2x1c3RlcmZzIGBob3N0bmFtZWA6JFZPTCAiJENUREJfTU5UIiAmJiBcCiAgICAgICAgYWRkX2ZzdGFiX2VudHJ5ICRWT0wgJENUREJfTU5UCiAgICBjaGtjb25maWcgY3RkYiBvbgpmaQo=, log id: 1f0d891b >2014-01-30 06:42:35,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-48) [511b856] FINISH, GetGlusterHookContentVDSCommand, return: IyEvYmluL2Jhc2gKCiNUaGUgcHJlZmVycmVkIHdheSBvZiBjcmVhdGluZyBhIHNtYiBzaGFyZSBvZiBhIGdsdXN0ZXIgdm9sdW1lIGhhcyBjaGFuZ2VkLgojVGhlIG9sZCBtZXRob2Qgd2FzIHRvIGNyZWF0ZSBhIGZ1c2UgbW91bnQgb2YgdGhlIHZvbHVtZSBhbmQgc2hhcmUgdGhlIG1vdW50CiNwb2ludCB0aHJvdWdoIHNhbWJhLgojCiNOZXcgbWV0aG9kIGVsaW1pbmF0ZXMgdGhlIHJlcXVpcmVtZW50IG9mIGZ1c2UgbW91bnQgYW5kIGNoYW5nZXMgaW4gZnN0YWIuCiNnbHVzdGVyZnNfdmZzIHBsdWdpbiBmb3Igc2FtYmEgbWFrZXMgY2FsbCB0byBsaWJnZmFwaSB0byBhY2Nlc3MgdGhlIHZvbHVtZS4KIwojVGhpcyBob29rIHNjcmlwdCBhdXRvbWFnaWNhbGx5IGNyZWF0ZXMgc2hhcmVzIGZvciB2b2x1bWUgb24gZXZlcnkgdm9sdW1lIHN0YXJ0CiNldmVudCBieSBhZGRpbmcgdGhlIGVudHJpZXMgaW4gc21iLmNvbmYgZmlsZSBhbmQgc2VuZGluZyBTSUdIVVAgdG8gc2FtYmEuCiMKI0luIHNtYi5jb25mOgojZ2x1c3RlcmZzIHZmcyBwbHVnaW4gaGFzIHRvIGJlIHNwZWNpZmllZCBhcyByZXF1aXJlZCB2ZnMgb2JqZWN0LgojUGF0aCB2YWx1ZSBpcyByZWxhdGl2ZSB0byB0aGUgcm9vdCBvZiBnbHVzdGVyIHZvbHVtZTsiLyIgc2lnbmlmaWVzIGNvbXBsZXRlCiN2b2x1bWUuCgpQUk9HTkFNRT0iU3NhbWJhLXN0YXJ0IgpPUFRTUEVDPSJ2b2xuYW1lOiIKVk9MPQoKZnVuY3Rpb24gcGFyc2VfYXJncyAoKSB7CiAgICAgICAgQVJHUz0kKGdldG9wdCAtbCAkT1BUU1BFQyAgLW5hbWUgJFBST0dOQU1FICRAKQogICAgICAgIGV2YWwgc2V0IC0tICIkQVJHUyIKCiAgICAgICAgd2hpbGUgdHJ1ZTsgZG8KICAgICAgICBjYXNlICQxIGluCiAgICAgICAgLS12b2xuYW1lKQogICAgICAgICBzaGlmdAogICAgICAgICBWT0w9JDEKICAgICAgICAgOzsKICAgICAgICAqKQogICAgICAgICBzaGlmdAogICAgICAgICBicmVhawogICAgICAgICA7OwogICAgICAgIGVzYWMKICAgICAgICBzaGlmdAogICAgICAgIGRvbmUKfQoKZnVuY3Rpb24gYWRkX3NhbWJhX3NoYXJlICgpIHsKICAgICAgICB2b2xuYW1lPSQxCiAgICAgICAgU1RSSU5HPSJcbltnbHVzdGVyLSR2b2xuYW1lXVxuIgogICAgICAgIFNUUklORys9ImNvbW1lbnQgPSBGb3Igc2FtYmEgc2hhcmUgb2Ygdm9sdW1lICR2b2xuYW1lXG4iCiAgICAgICAgU1RSSU5HKz0idmZzIG9iamVjdHMgPSBnbHVzdGVyZnNcbiIKICAgICAgICBTVFJJTkcrPSJnbHVzdGVyZnM6dm9sdW1lID0gJHZvbG5hbWVcbiIKICAgICAgICBTVFJJTkcrPSJnbHVzdGVyZnM6bG9nZmlsZSA9IC92YXIvbG9nL3NhbWJhL2dsdXN0ZXJmcy0kdm9sbmFtZS4lJU0ubG9nXG4iCiAgICAgICAgU1RSSU5HKz0iZ2x1c3RlcmZzOmxvZ2xldmVsID0gN1xuIgogICAgICAgIFNUUklORys9InBhdGggPSAvXG4iCiAgICAgICAgU1RSSU5HKz0icmVhZCBvbmx5ID0gbm9cbiIKICAgICAgICBTVFJJTkcrPSJndWVzdCBvayA9IHllc1xuIgogICAgICAgIHByaW50ZiAiJFNUUklORyIgID4+IC9ldGMvc2FtYmEvc21iLmNvbmYKfQoKZnVuY3Rpb24gc2lnaHVwX3NhbWJhICgpIHsKICAgICAgICBwaWQ9YGNhdCAvdmFyL3J1bi9zbWJkLnBpZGAKICAgICAgICBpZiBbICJ4JHBpZCIgIT0gIngiIF0KICAgICAgICB0aGVuCiAgICAgICAgICAgICAgICBraWxsIC1IVVAgIiRwaWQiOwogICAgICAgIGVsc2UKICAgICAgICAgICAgICAgIC9ldGMvaW5pdC5kL3NtYiBjb25kcmVzdGFydAogICAgICAgIGZpCn0KCmZ1bmN0aW9uIGdldF9zbWIgKCkgewogICAgICAgIHZvbG5hbWU9JDEKICAgICAgICB1c2VydmFsdWU9CgogICAgICAgIHVzZXJjaWZzdmFsdWU9JChncmVwIHVzZXIuY2lmcyAvdmFyL2xpYi9nbHVzdGVyZC92b2xzLyIkdm9sbmFtZSIvaW5mbyB8XAogICAgICAgICAgICAgICAgICAgICAgICBjdXQgLWQiPSIgLWYyKQogICAgICAgIHVzZXJzbWJ2YWx1ZT0kKGdyZXAgdXNlci5zbWIgL3Zhci9saWIvZ2x1c3RlcmQvdm9scy8iJHZvbG5hbWUiL2luZm8gfFwKICAgICAgICAgICAgICAgICAgICAgICBjdXQgLWQiPSIgLWYyKQoKICAgICAgICBpZiBbWyAkdXNlcmNpZnN2YWx1ZSA9ICJkaXNhYmxlIiB8fCAkdXNlcnNtYnZhbHVlID0gImRpc2FibGUiIF1dOyB0aGVuCiAgICAgICAgICAgICAgICB1c2VydmFsdWU9ImRpc2FibGUiCiAgICAgICAgZmkKICAgICAgICBlY2hvICIkdXNlcnZhbHVlIgp9CgpwYXJzZV9hcmdzICRACmlmIFsgJChnZXRfc21iICIkVk9MIikgPSAiZGlzYWJsZSIgXTsgdGhlbgogICAgICAgIGV4aXQgMApmaQoKaWYgISBncmVwIC0tcXVpZXQgIlxbZ2x1c3Rlci0kVk9MXF0iIC9ldGMvc2FtYmEvc21iLmNvbmYgOyB0aGVuCiAgICAgICAgYWRkX3NhbWJhX3NoYXJlICRWT0wKICAgICAgICBzaWdodXBfc2FtYmEKZmkK, log id: 6de6dc78 >2014-01-30 06:42:35,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-33) [511b856] FINISH, GetGlusterHookContentVDSCommand, return: IyEvYmluL2Jhc2gKCiNUaGUgcHJlZmVycmVkIHdheSBvZiBjcmVhdGluZyBhIHNtYiBzaGFyZSBvZiBhIGdsdXN0ZXIgdm9sdW1lIGhhcyBjaGFuZ2VkLgojVGhlIG9sZCBtZXRob2Qgd2FzIHRvIGNyZWF0ZSBhIGZ1c2UgbW91bnQgb2YgdGhlIHZvbHVtZSBhbmQgc2hhcmUgdGhlIG1vdW50CiNwb2ludCB0aHJvdWdoIHNhbWJhLgojCiNOZXcgbWV0aG9kIGVsaW1pbmF0ZXMgdGhlIHJlcXVpcmVtZW50IG9mIGZ1c2UgbW91bnQgYW5kIGNoYW5nZXMgaW4gZnN0YWIuCiNnbHVzdGVyZnNfdmZzIHBsdWdpbiBmb3Igc2FtYmEgbWFrZXMgY2FsbCB0byBsaWJnZmFwaSB0byBhY2Nlc3MgdGhlIHZvbHVtZS4KIwojVGhpcyBob29rIHNjcmlwdCBhdXRvbWFnaWNhbGx5IGNyZWF0ZXMgc2hhcmVzIGZvciB2b2x1bWUgb24gZXZlcnkgdm9sdW1lIHN0YXJ0CiNldmVudCBieSBhZGRpbmcgdGhlIGVudHJpZXMgaW4gc21iLmNvbmYgZmlsZSBhbmQgc2VuZGluZyBTSUdIVVAgdG8gc2FtYmEuCiMKI0luIHNtYi5jb25mOgojZ2x1c3RlcmZzIHZmcyBwbHVnaW4gaGFzIHRvIGJlIHNwZWNpZmllZCBhcyByZXF1aXJlZCB2ZnMgb2JqZWN0LgojUGF0aCB2YWx1ZSBpcyByZWxhdGl2ZSB0byB0aGUgcm9vdCBvZiBnbHVzdGVyIHZvbHVtZTsiLyIgc2lnbmlmaWVzIGNvbXBsZXRlCiN2b2x1bWUuCgpQUk9HTkFNRT0iU3NhbWJhLXN0YXJ0IgpPUFRTUEVDPSJ2b2xuYW1lOiIKVk9MPQoKZnVuY3Rpb24gcGFyc2VfYXJncyAoKSB7CiAgICAgICAgQVJHUz0kKGdldG9wdCAtbCAkT1BUU1BFQyAgLW5hbWUgJFBST0dOQU1FICRAKQogICAgICAgIGV2YWwgc2V0IC0tICIkQVJHUyIKCiAgICAgICAgd2hpbGUgdHJ1ZTsgZG8KICAgICAgICBjYXNlICQxIGluCiAgICAgICAgLS12b2xuYW1lKQogICAgICAgICBzaGlmdAogICAgICAgICBWT0w9JDEKICAgICAgICAgOzsKICAgICAgICAqKQogICAgICAgICBzaGlmdAogICAgICAgICBicmVhawogICAgICAgICA7OwogICAgICAgIGVzYWMKICAgICAgICBzaGlmdAogICAgICAgIGRvbmUKfQoKZnVuY3Rpb24gYWRkX3NhbWJhX3NoYXJlICgpIHsKICAgICAgICB2b2xuYW1lPSQxCiAgICAgICAgU1RSSU5HPSJcbltnbHVzdGVyLSR2b2xuYW1lXVxuIgogICAgICAgIFNUUklORys9ImNvbW1lbnQgPSBGb3Igc2FtYmEgc2hhcmUgb2Ygdm9sdW1lICR2b2xuYW1lXG4iCiAgICAgICAgU1RSSU5HKz0idmZzIG9iamVjdHMgPSBnbHVzdGVyZnNcbiIKICAgICAgICBTVFJJTkcrPSJnbHVzdGVyZnM6dm9sdW1lID0gJHZvbG5hbWVcbiIKICAgICAgICBTVFJJTkcrPSJnbHVzdGVyZnM6bG9nZmlsZSA9IC92YXIvbG9nL3NhbWJhL2dsdXN0ZXJmcy0kdm9sbmFtZS4lJU0ubG9nXG4iCiAgICAgICAgU1RSSU5HKz0iZ2x1c3RlcmZzOmxvZ2xldmVsID0gN1xuIgogICAgICAgIFNUUklORys9InBhdGggPSAvXG4iCiAgICAgICAgU1RSSU5HKz0icmVhZCBvbmx5ID0gbm9cbiIKICAgICAgICBTVFJJTkcrPSJndWVzdCBvayA9IHllc1xuIgogICAgICAgIHByaW50ZiAiJFNUUklORyIgID4+IC9ldGMvc2FtYmEvc21iLmNvbmYKfQoKZnVuY3Rpb24gc2lnaHVwX3NhbWJhICgpIHsKICAgICAgICBwaWQ9YGNhdCAvdmFyL3J1bi9zbWJkLnBpZGAKICAgICAgICBpZiBbICJ4JHBpZCIgIT0gIngiIF0KICAgICAgICB0aGVuCiAgICAgICAgICAgICAgICBraWxsIC1IVVAgIiRwaWQiOwogICAgICAgIGVsc2UKICAgICAgICAgICAgICAgIC9ldGMvaW5pdC5kL3NtYiBjb25kcmVzdGFydAogICAgICAgIGZpCn0KCmZ1bmN0aW9uIGdldF9zbWIgKCkgewogICAgICAgIHZvbG5hbWU9JDEKICAgICAgICB1c2VydmFsdWU9CgogICAgICAgIHVzZXJjaWZzdmFsdWU9JChncmVwIHVzZXIuY2lmcyAvdmFyL2xpYi9nbHVzdGVyZC92b2xzLyIkdm9sbmFtZSIvaW5mbyB8XAogICAgICAgICAgICAgICAgICAgICAgICBjdXQgLWQiPSIgLWYyKQogICAgICAgIHVzZXJzbWJ2YWx1ZT0kKGdyZXAgdXNlci5zbWIgL3Zhci9saWIvZ2x1c3RlcmQvdm9scy8iJHZvbG5hbWUiL2luZm8gfFwKICAgICAgICAgICAgICAgICAgICAgICBjdXQgLWQiPSIgLWYyKQoKICAgICAgICBpZiBbWyAkdXNlcmNpZnN2YWx1ZSA9ICJkaXNhYmxlIiB8fCAkdXNlcnNtYnZhbHVlID0gImRpc2FibGUiIF1dOyB0aGVuCiAgICAgICAgICAgICAgICB1c2VydmFsdWU9ImRpc2FibGUiCiAgICAgICAgZmkKICAgICAgICBlY2hvICIkdXNlcnZhbHVlIgp9CgpwYXJzZV9hcmdzICRACmlmIFsgJChnZXRfc21iICIkVk9MIikgPSAiZGlzYWJsZSIgXTsgdGhlbgogICAgICAgIGV4aXQgMApmaQoKaWYgISBncmVwIC0tcXVpZXQgIlxbZ2x1c3Rlci0kVk9MXF0iIC9ldGMvc2FtYmEvc21iLmNvbmYgOyB0aGVuCiAgICAgICAgYWRkX3NhbWJhX3NoYXJlICRWT0wKICAgICAgICBzaWdodXBfc2FtYmEKZmkK, log id: 686fee58 >2014-01-30 06:42:35,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-30) [511b856] FINISH, GetGlusterHookContentVDSCommand, return: IyEvYmluL3NoCgojIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjCiMjIC0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KIyMgVGhlIHNjcmlwdHMKIyMgSS4gICBhZGQtYnJpY2svcHJlL1MyOFF1b3RhLXJvb3QteGF0dHItaGVhbC5zaCAoaXRzZWxmKQojIyBJSS4gIGFkZC1icmljay9wb3N0L2Rpc2FibGVkLXJvb3QteGF0dHItaGVhbC5zaCBBTkQKIyMgY29sbGVjdGl2ZWx5IGFjaGVpdmVzIHRoZSBqb2Igb2YgaGVhbGluZyB0aGUgJ2xpbWl0LXNldCcgeGF0dHIgdXBvbgojIyBhZGQtYnJpY2sgdG8gdGhlIGdsdXN0ZXIgdm9sdW1lLgojIwojIyBUaGlzIHNjcmlwdCBpcyB0aGUgJ2NvbnRyb2xsaW5nJyBzY3JpcHQuIFVwb24gYWRkLWJyaWNrIHRoaXMgc2NyaXB0IGVuYWJsZXMKIyMgdGhlIGNvcnJlc3BvbmRpbmcgc2NyaXB0IGJhc2VkIG9uIHRoZSBzdGF0dXMgb2YgdGhlIHZvbHVtZS4KIyMgSWYgdm9sdW1lIGlzIHN0YXJ0ZWQgLSBlbmFibGUgYWRkLWJyaWNrL3Bvc3Qgc2NyaXB0CiMjIGVsc2UgICAgICAgICAgICAgICAgIC0gZW5hYmxlIHN0YXJ0L3Bvc3Qgc2NyaXB0LgojIwojIyBUaGUgZW5hYmxpbmcgYW5kIGRpc2FibGluZyBvZiBhIHNjcmlwdCBpcyBiYXNlZCBvbiB0aGUgZ2x1c3RlcmQncyBsb2dpYywKIyMgdGhhdCBpdCBvbmx5IHJ1bnMgdGhlIHNjcmlwdHMgd2hpY2ggc3RhcnRzIGl0cyBuYW1lIHdpdGggJ1MnLiBTbywKIyMgRW5hYmxlIC0gc3ltbGluayB0aGUgZmlsZSB0byAnUycqLgojIyBEaXNhYmxlLSB1bmxpbmsgc3ltbGluawojIyAtLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCiMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMKCk9QVFNQRUM9InZvbG5hbWU6LHZlcnNpb246LGdkLXdvcmtkaXI6LHZvbHVtZS1vcDoiClBST0dOQU1FPSJRdW90YS14YXR0ci1oZWFsLWFkZC1icmljay1wcmUiClZPTF9OQU1FPQpHTFVTVEVSRF9XT1JLSU5HX0RJUj0KVk9MVU1FX09QPQpWRVJTSU9OPQpFTkFCTEVEX05BTUU9IlMyOFF1b3RhLXJvb3QteGF0dHItaGVhbC5zaCIKRElTQUJMRURfTkFNRT0iZGlzYWJsZWQtcXVvdGEtcm9vdC14YXR0ci1oZWFsLnNoIgoKZW5hYmxlICgpCnsKICAgICAgICBsbiAtc2YgJERJU0FCTEVEX1NUQVRFICQxOwp9CgojIy0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQojIyBQYXJzZSB0aGUgYXJndW1lbnRzCiMjLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCkFSR1M9JChnZXRvcHQgLWwgJE9QVFNQRUMgIC1uYW1lICRQUk9HTkFNRSAkQCkKZXZhbCBzZXQgLS0gIiRBUkdTIgoKd2hpbGUgdHJ1ZTsKZG8KICAgICAgICBjYXNlICQxIGluCiAgICAgICAgLS12b2xuYW1lKQogICAgICAgICAgICAgICAgIHNoaWZ0CiAgICAgICAgICAgICAgICAgVk9MX05BTUU9JDEKICAgICAgICAgICAgICAgICA7OwogICAgICAgIC0tZ2Qtd29ya2RpcikKICAgICAgICAgICAgICAgICBzaGlmdAogICAgICAgICAgICAgICAgIEdMVVNURVJEX1dPUktJTkdfRElSPSQxCiAgICAgICAgICAgICAgICAgOzsKICAgICAgICAtLXZvbHVtZS1vcCkKICAgICAgICAgICAgICAgICBzaGlmdAogICAgICAgICAgICAgICAgIFZPTFVNRV9PUD0kMQogICAgICAgICAgICAgICAgIDs7CiAgICAgICAgLS12ZXJzaW9uKQogICAgICAgICAgICAgICAgIHNoaWZ0CiAgICAgICAgICAgICAgICAgVkVSU0lPTj0kMQogICAgICAgICAgICAgICAgIDs7CiAgICAgICAgKikKICAgICAgICAgICAgICAgICBzaGlmdAogICAgICAgICAgICAgICAgIGJyZWFrCiAgICAgICAgICAgICAgICAgOzsKICAgICAgICBlc2FjCiAgICAgICAgc2hpZnQKZG9uZQojIy0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KCkRJU0FCTEVEX1NUQVRFPSIkR0xVU1RFUkRfV09SS0lOR19ESVIvaG9va3MvJFZFUlNJT04vYWRkLWJyaWNrL3Bvc3QvJERJU0FCTEVEX05BTUUiCkVOQUJMRURfU1RBVEVfU1RBUlQ9IiRHTFVTVEVSRF9XT1JLSU5HX0RJUi9ob29rcy8kVkVSU0lPTi9zdGFydC9wb3N0LyRFTkFCTEVEX05BTUUiCkVOQUJMRURfU1RBVEVfQUREX0JSSUNLPSIkR0xVU1RFUkRfV09SS0lOR19ESVIvaG9va3MvJFZFUlNJT04vYWRkLWJyaWNrL3Bvc3QvJEVOQUJMRURfTkFNRSI7CgojIyBXaHkgdG8gcHJvY2VlZCBpZiB0aGUgcmVxdWlyZWQgc2NyaXB0IGl0c2VsZiBpcyBub3QgcHJlc2VudD8KbHMgJERJU0FCTEVEX1NUQVRFOwppZiBbIDAgLW5lICQ/IF0KdGhlbgogICAgICAgIGV4aXQgJD87CmZpCgojIyBJcyBxdW90YSBlbmFibGVkPwpGTEFHPWBjYXQgJEdMVVNURVJEX1dPUktJTkdfRElSL3ZvbHMvJFZPTF9OQU1FL2luZm8gfCBncmVwICJeZmVhdHVyZXMucXVvdGE9IiBcCiAgICAgIHwgYXdrIC1GJz0nICd7cHJpbnQgJE5GfSdgOwppZiBbICIkRkxBRyIgIT0gIm9uIiBdCnRoZW4KICAgICAgICBleGl0ICRFWElUX1NVQ0NFU1M7CmZpCgojIyBJcyB2b2x1bWUgc3RhcnRlZD8KRkxBRz1gY2F0ICRHTFVTVEVSRF9XT1JLSU5HX0RJUi92b2xzLyRWT0xfTkFNRS9pbmZvIHwgZ3JlcCAiXnN0YXR1cz0iIFwKICAgICAgfCBhd2sgLUYnPScgJ3twcmludCAkTkZ9J2A7CmlmIFsgIiRGTEFHIiAhPSAiMSIgXQp0aGVuCiAgICAgICAgZW5hYmxlICRFTkFCTEVEX1NUQVRFX1NUQVJUOwogICAgICAgIGV4aXQgJD8KZmkKCmVuYWJsZSAkRU5BQkxFRF9TVEFURV9BRERfQlJJQ0s7CmV4aXQgJD8K, log id: 6ad5f868 >2014-01-30 06:42:35,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-27) [511b856] FINISH, GetGlusterHookContentVDSCommand, return: IyEvYmluL3NoCgojIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjCiMjIC0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KIyMgVGhlIHNjcmlwdHMKIyMgSS4gICBhZGQtYnJpY2svcHJlL1MyOFF1b3RhLXJvb3QteGF0dHItaGVhbC5zaCAoaXRzZWxmKQojIyBJSS4gIGFkZC1icmljay9wb3N0L2Rpc2FibGVkLXJvb3QteGF0dHItaGVhbC5zaCBBTkQKIyMgY29sbGVjdGl2ZWx5IGFjaGVpdmVzIHRoZSBqb2Igb2YgaGVhbGluZyB0aGUgJ2xpbWl0LXNldCcgeGF0dHIgdXBvbgojIyBhZGQtYnJpY2sgdG8gdGhlIGdsdXN0ZXIgdm9sdW1lLgojIwojIyBUaGlzIHNjcmlwdCBpcyB0aGUgJ2NvbnRyb2xsaW5nJyBzY3JpcHQuIFVwb24gYWRkLWJyaWNrIHRoaXMgc2NyaXB0IGVuYWJsZXMKIyMgdGhlIGNvcnJlc3BvbmRpbmcgc2NyaXB0IGJhc2VkIG9uIHRoZSBzdGF0dXMgb2YgdGhlIHZvbHVtZS4KIyMgSWYgdm9sdW1lIGlzIHN0YXJ0ZWQgLSBlbmFibGUgYWRkLWJyaWNrL3Bvc3Qgc2NyaXB0CiMjIGVsc2UgICAgICAgICAgICAgICAgIC0gZW5hYmxlIHN0YXJ0L3Bvc3Qgc2NyaXB0LgojIwojIyBUaGUgZW5hYmxpbmcgYW5kIGRpc2FibGluZyBvZiBhIHNjcmlwdCBpcyBiYXNlZCBvbiB0aGUgZ2x1c3RlcmQncyBsb2dpYywKIyMgdGhhdCBpdCBvbmx5IHJ1bnMgdGhlIHNjcmlwdHMgd2hpY2ggc3RhcnRzIGl0cyBuYW1lIHdpdGggJ1MnLiBTbywKIyMgRW5hYmxlIC0gc3ltbGluayB0aGUgZmlsZSB0byAnUycqLgojIyBEaXNhYmxlLSB1bmxpbmsgc3ltbGluawojIyAtLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCiMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMKCk9QVFNQRUM9InZvbG5hbWU6LHZlcnNpb246LGdkLXdvcmtkaXI6LHZvbHVtZS1vcDoiClBST0dOQU1FPSJRdW90YS14YXR0ci1oZWFsLWFkZC1icmljay1wcmUiClZPTF9OQU1FPQpHTFVTVEVSRF9XT1JLSU5HX0RJUj0KVk9MVU1FX09QPQpWRVJTSU9OPQpFTkFCTEVEX05BTUU9IlMyOFF1b3RhLXJvb3QteGF0dHItaGVhbC5zaCIKRElTQUJMRURfTkFNRT0iZGlzYWJsZWQtcXVvdGEtcm9vdC14YXR0ci1oZWFsLnNoIgoKZW5hYmxlICgpCnsKICAgICAgICBsbiAtc2YgJERJU0FCTEVEX1NUQVRFICQxOwp9CgojIy0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQojIyBQYXJzZSB0aGUgYXJndW1lbnRzCiMjLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCkFSR1M9JChnZXRvcHQgLWwgJE9QVFNQRUMgIC1uYW1lICRQUk9HTkFNRSAkQCkKZXZhbCBzZXQgLS0gIiRBUkdTIgoKd2hpbGUgdHJ1ZTsKZG8KICAgICAgICBjYXNlICQxIGluCiAgICAgICAgLS12b2xuYW1lKQogICAgICAgICAgICAgICAgIHNoaWZ0CiAgICAgICAgICAgICAgICAgVk9MX05BTUU9JDEKICAgICAgICAgICAgICAgICA7OwogICAgICAgIC0tZ2Qtd29ya2RpcikKICAgICAgICAgICAgICAgICBzaGlmdAogICAgICAgICAgICAgICAgIEdMVVNURVJEX1dPUktJTkdfRElSPSQxCiAgICAgICAgICAgICAgICAgOzsKICAgICAgICAtLXZvbHVtZS1vcCkKICAgICAgICAgICAgICAgICBzaGlmdAogICAgICAgICAgICAgICAgIFZPTFVNRV9PUD0kMQogICAgICAgICAgICAgICAgIDs7CiAgICAgICAgLS12ZXJzaW9uKQogICAgICAgICAgICAgICAgIHNoaWZ0CiAgICAgICAgICAgICAgICAgVkVSU0lPTj0kMQogICAgICAgICAgICAgICAgIDs7CiAgICAgICAgKikKICAgICAgICAgICAgICAgICBzaGlmdAogICAgICAgICAgICAgICAgIGJyZWFrCiAgICAgICAgICAgICAgICAgOzsKICAgICAgICBlc2FjCiAgICAgICAgc2hpZnQKZG9uZQojIy0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KCkRJU0FCTEVEX1NUQVRFPSIkR0xVU1RFUkRfV09SS0lOR19ESVIvaG9va3MvJFZFUlNJT04vYWRkLWJyaWNrL3Bvc3QvJERJU0FCTEVEX05BTUUiCkVOQUJMRURfU1RBVEVfU1RBUlQ9IiRHTFVTVEVSRF9XT1JLSU5HX0RJUi9ob29rcy8kVkVSU0lPTi9zdGFydC9wb3N0LyRFTkFCTEVEX05BTUUiCkVOQUJMRURfU1RBVEVfQUREX0JSSUNLPSIkR0xVU1RFUkRfV09SS0lOR19ESVIvaG9va3MvJFZFUlNJT04vYWRkLWJyaWNrL3Bvc3QvJEVOQUJMRURfTkFNRSI7CgojIyBXaHkgdG8gcHJvY2VlZCBpZiB0aGUgcmVxdWlyZWQgc2NyaXB0IGl0c2VsZiBpcyBub3QgcHJlc2VudD8KbHMgJERJU0FCTEVEX1NUQVRFOwppZiBbIDAgLW5lICQ/IF0KdGhlbgogICAgICAgIGV4aXQgJD87CmZpCgojIyBJcyBxdW90YSBlbmFibGVkPwpGTEFHPWBjYXQgJEdMVVNURVJEX1dPUktJTkdfRElSL3ZvbHMvJFZPTF9OQU1FL2luZm8gfCBncmVwICJeZmVhdHVyZXMucXVvdGE9IiBcCiAgICAgIHwgYXdrIC1GJz0nICd7cHJpbnQgJE5GfSdgOwppZiBbICIkRkxBRyIgIT0gIm9uIiBdCnRoZW4KICAgICAgICBleGl0ICRFWElUX1NVQ0NFU1M7CmZpCgojIyBJcyB2b2x1bWUgc3RhcnRlZD8KRkxBRz1gY2F0ICRHTFVTVEVSRF9XT1JLSU5HX0RJUi92b2xzLyRWT0xfTkFNRS9pbmZvIHwgZ3JlcCAiXnN0YXR1cz0iIFwKICAgICAgfCBhd2sgLUYnPScgJ3twcmludCAkTkZ9J2A7CmlmIFsgIiRGTEFHIiAhPSAiMSIgXQp0aGVuCiAgICAgICAgZW5hYmxlICRFTkFCTEVEX1NUQVRFX1NUQVJUOwogICAgICAgIGV4aXQgJD8KZmkKCmVuYWJsZSAkRU5BQkxFRF9TVEFURV9BRERfQlJJQ0s7CmV4aXQgJD8K, log id: 73970d3b >2014-01-30 06:42:35,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-26) [511b856] FINISH, GetGlusterHookContentVDSCommand, return: IyEvYmluL3NoCgojIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjCiMjIC0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KIyMgVGhlIHNjcmlwdHMKIyMgSS4gICBhZGQtYnJpY2svcHJlL1MyOFF1b3RhLXJvb3QteGF0dHItaGVhbC5zaCAoaXRzZWxmKQojIyBJSS4gIGFkZC1icmljay9wb3N0L2Rpc2FibGVkLXJvb3QteGF0dHItaGVhbC5zaCBBTkQKIyMgY29sbGVjdGl2ZWx5IGFjaGVpdmVzIHRoZSBqb2Igb2YgaGVhbGluZyB0aGUgJ2xpbWl0LXNldCcgeGF0dHIgdXBvbgojIyBhZGQtYnJpY2sgdG8gdGhlIGdsdXN0ZXIgdm9sdW1lLgojIwojIyBUaGlzIHNjcmlwdCBpcyB0aGUgJ2NvbnRyb2xsaW5nJyBzY3JpcHQuIFVwb24gYWRkLWJyaWNrIHRoaXMgc2NyaXB0IGVuYWJsZXMKIyMgdGhlIGNvcnJlc3BvbmRpbmcgc2NyaXB0IGJhc2VkIG9uIHRoZSBzdGF0dXMgb2YgdGhlIHZvbHVtZS4KIyMgSWYgdm9sdW1lIGlzIHN0YXJ0ZWQgLSBlbmFibGUgYWRkLWJyaWNrL3Bvc3Qgc2NyaXB0CiMjIGVsc2UgICAgICAgICAgICAgICAgIC0gZW5hYmxlIHN0YXJ0L3Bvc3Qgc2NyaXB0LgojIwojIyBUaGUgZW5hYmxpbmcgYW5kIGRpc2FibGluZyBvZiBhIHNjcmlwdCBpcyBiYXNlZCBvbiB0aGUgZ2x1c3RlcmQncyBsb2dpYywKIyMgdGhhdCBpdCBvbmx5IHJ1bnMgdGhlIHNjcmlwdHMgd2hpY2ggc3RhcnRzIGl0cyBuYW1lIHdpdGggJ1MnLiBTbywKIyMgRW5hYmxlIC0gc3ltbGluayB0aGUgZmlsZSB0byAnUycqLgojIyBEaXNhYmxlLSB1bmxpbmsgc3ltbGluawojIyAtLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCiMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMjIyMKCk9QVFNQRUM9InZvbG5hbWU6LHZlcnNpb246LGdkLXdvcmtkaXI6LHZvbHVtZS1vcDoiClBST0dOQU1FPSJRdW90YS14YXR0ci1oZWFsLWFkZC1icmljay1wcmUiClZPTF9OQU1FPQpHTFVTVEVSRF9XT1JLSU5HX0RJUj0KVk9MVU1FX09QPQpWRVJTSU9OPQpFTkFCTEVEX05BTUU9IlMyOFF1b3RhLXJvb3QteGF0dHItaGVhbC5zaCIKRElTQUJMRURfTkFNRT0iZGlzYWJsZWQtcXVvdGEtcm9vdC14YXR0ci1oZWFsLnNoIgoKZW5hYmxlICgpCnsKICAgICAgICBsbiAtc2YgJERJU0FCTEVEX1NUQVRFICQxOwp9CgojIy0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQojIyBQYXJzZSB0aGUgYXJndW1lbnRzCiMjLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCkFSR1M9JChnZXRvcHQgLWwgJE9QVFNQRUMgIC1uYW1lICRQUk9HTkFNRSAkQCkKZXZhbCBzZXQgLS0gIiRBUkdTIgoKd2hpbGUgdHJ1ZTsKZG8KICAgICAgICBjYXNlICQxIGluCiAgICAgICAgLS12b2xuYW1lKQogICAgICAgICAgICAgICAgIHNoaWZ0CiAgICAgICAgICAgICAgICAgVk9MX05BTUU9JDEKICAgICAgICAgICAgICAgICA7OwogICAgICAgIC0tZ2Qtd29ya2RpcikKICAgICAgICAgICAgICAgICBzaGlmdAogICAgICAgICAgICAgICAgIEdMVVNURVJEX1dPUktJTkdfRElSPSQxCiAgICAgICAgICAgICAgICAgOzsKICAgICAgICAtLXZvbHVtZS1vcCkKICAgICAgICAgICAgICAgICBzaGlmdAogICAgICAgICAgICAgICAgIFZPTFVNRV9PUD0kMQogICAgICAgICAgICAgICAgIDs7CiAgICAgICAgLS12ZXJzaW9uKQogICAgICAgICAgICAgICAgIHNoaWZ0CiAgICAgICAgICAgICAgICAgVkVSU0lPTj0kMQogICAgICAgICAgICAgICAgIDs7CiAgICAgICAgKikKICAgICAgICAgICAgICAgICBzaGlmdAogICAgICAgICAgICAgICAgIGJyZWFrCiAgICAgICAgICAgICAgICAgOzsKICAgICAgICBlc2FjCiAgICAgICAgc2hpZnQKZG9uZQojIy0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KCkRJU0FCTEVEX1NUQVRFPSIkR0xVU1RFUkRfV09SS0lOR19ESVIvaG9va3MvJFZFUlNJT04vYWRkLWJyaWNrL3Bvc3QvJERJU0FCTEVEX05BTUUiCkVOQUJMRURfU1RBVEVfU1RBUlQ9IiRHTFVTVEVSRF9XT1JLSU5HX0RJUi9ob29rcy8kVkVSU0lPTi9zdGFydC9wb3N0LyRFTkFCTEVEX05BTUUiCkVOQUJMRURfU1RBVEVfQUREX0JSSUNLPSIkR0xVU1RFUkRfV09SS0lOR19ESVIvaG9va3MvJFZFUlNJT04vYWRkLWJyaWNrL3Bvc3QvJEVOQUJMRURfTkFNRSI7CgojIyBXaHkgdG8gcHJvY2VlZCBpZiB0aGUgcmVxdWlyZWQgc2NyaXB0IGl0c2VsZiBpcyBub3QgcHJlc2VudD8KbHMgJERJU0FCTEVEX1NUQVRFOwppZiBbIDAgLW5lICQ/IF0KdGhlbgogICAgICAgIGV4aXQgJD87CmZpCgojIyBJcyBxdW90YSBlbmFibGVkPwpGTEFHPWBjYXQgJEdMVVNURVJEX1dPUktJTkdfRElSL3ZvbHMvJFZPTF9OQU1FL2luZm8gfCBncmVwICJeZmVhdHVyZXMucXVvdGE9IiBcCiAgICAgIHwgYXdrIC1GJz0nICd7cHJpbnQgJE5GfSdgOwppZiBbICIkRkxBRyIgIT0gIm9uIiBdCnRoZW4KICAgICAgICBleGl0ICRFWElUX1NVQ0NFU1M7CmZpCgojIyBJcyB2b2x1bWUgc3RhcnRlZD8KRkxBRz1gY2F0ICRHTFVTVEVSRF9XT1JLSU5HX0RJUi92b2xzLyRWT0xfTkFNRS9pbmZvIHwgZ3JlcCAiXnN0YXR1cz0iIFwKICAgICAgfCBhd2sgLUYnPScgJ3twcmludCAkTkZ9J2A7CmlmIFsgIiRGTEFHIiAhPSAiMSIgXQp0aGVuCiAgICAgICAgZW5hYmxlICRFTkFCTEVEX1NUQVRFX1NUQVJUOwogICAgICAgIGV4aXQgJD8KZmkKCmVuYWJsZSAkRU5BQkxFRF9TVEFURV9BRERfQlJJQ0s7CmV4aXQgJD8K, log id: 7921e041 >2014-01-30 06:42:35,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-31) [511b856] FINISH, GetGlusterHookContentVDSCommand, return: IyEgL2Jpbi9iYXNoCiMgUkhTLTIuMCBvbmx5CiMgLSBUaGUgc2NyaXB0IG1vdW50cyB0aGUgJ21ldGEtdm9sJyBvbiBzdGFydCAnZXZlbnQnIG9uIGEga25vd24KIyAgIGRpcmVjdG9yeSAoZWcuIC9nbHVzdGVyL2xvY2spCiMgLSBBZGRzIHRoZSBuZWNlc3NhcnkgY29uZmlndXJhdGlvbiBjaGFuZ2VzIGZvciBjdGRiIGluIHNtYi5jb25mIGFuZAojICAgcmVzdGFydHMgc21iIHNlcnZpY2UuCiMgLSBQLlM6IFRoZXJlIGFyZSBvdGhlciAndGFza3MnIHRoYXQgbmVlZCB0byBiZSBkb25lIG91dHNpZGUgdGhpcyBzY3JpcHQKIyAgIHRvIGdldCBDVERCIGJhc2VkIGZhaWxvdmVyIHVwIGFuZCBydW5uaW5nLgoKU01CX0NPTkY9L2V0Yy9zYW1iYS9zbWIuY29uZgoKQ1REQl9NTlQ9L2dsdXN0ZXIvbG9jawpQUk9HTkFNRT0iY3RkYiIKT1BUU1BFQz0idm9sbmFtZToiClZPTD0KIyAkTUVUQSBpcyB0aGUgdm9sdW1lIHRoYXQgd2lsbCBiZSB1c2VkIGJ5IENUREIgYXMgYSBzaGFyZWQgZmlsZXN5c3RlbS4KIyBJdCBpcyBub3QgZGVzaXJhYmxlIHRvIHVzZSB0aGlzIHZvbHVtZSBmb3Igc3RvcmluZyAnZGF0YScgYXMgd2VsbC4KIyBNRVRBIGlzIHNldCB0byAnYWxsJyAodml6LiBhIGtleXdvcmQgYW5kIGhlbmNlIG5vdCBhIGxlZ2FsIHZvbHVtZSBuYW1lKQojIHRvIHByZXZlbnQgdGhlIHNjcmlwdCBmcm9tIHJ1bm5pbmcgZm9yIHZvbHVtZXMgaXQgd2FzIG5vdCBpbnRlbmRlZC4KIyBVc2VyIG5lZWRzIHRvIHNldCBNRVRBIHRvIHRoZSB2b2x1bWUgdGhhdCBzZXJ2ZXMgQ1REQiBsb2NrZmlsZS4KTUVUQT0iYWxsIgoKZnVuY3Rpb24gcGFyc2VfYXJncyAoKSB7CiAgICAgICAgQVJHUz0kKGdldG9wdCAtbCAkT1BUU1BFQyAgLW5hbWUgJFBST0dOQU1FICRAKQogICAgICAgIGV2YWwgc2V0IC0tICIkQVJHUyIKCiAgICAgICAgd2hpbGUgdHJ1ZTsgZG8KICAgICAgICAgICAgY2FzZSAkMSBpbgogICAgICAgICAgICAgICAgLS12b2xuYW1lKQogICAgICAgICAgICAgICAgICAgIHNoaWZ0CiAgICAgICAgICAgICAgICAgICAgVk9MPSQxCiAgICAgICAgICAgICAgICA7OwoKICAgICAgICAgICAgICAgICopCiAgICAgICAgICAgICAgICAgICAgIHNoaWZ0CiAgICAgICAgICAgICAgICAgICAgIGJyZWFrCiAgICAgICAgICAgICAgICA7OwoKICAgICAgICAgICAgZXNhYwoKICAgICAgICAgICAgc2hpZnQKICAgICAgICBkb25lCn0KCmZ1bmN0aW9uIGFkZF9nbHVzdGVyZnNfY3RkYl9vcHRpb25zICgpIHsKICAgICAgICBQQVQ9IlNoYXJlIERlZmluaXRpb25zIgogICAgICAgIEdMVVNURVJfQ1REQl9DT05GSUc9IiMgY3RkYiBjb25maWcgZm9yIGdsdXN0ZXJmc1xuXHRjbHVzdGVyaW5nID0geWVzXG5cdGlkbWFwIGJhY2tlbmQgPSB0ZGIyXG4iCiAgICAgICAgZXhpc3RzPWBncmVwICJjbHVzdGVyaW5nID0geWVzIiAiJFNNQl9DT05GImAKICAgICAgICBpZiBbICIkZXhpc3RzIiA9PSAiIiBdCiAgICAgICAgdGhlbgogICAgICAgICAgICBzZWQgLWkgLyIkUEFUIi9pXCAiJEdMVVNURVJfQ1REQl9DT05GSUciICIkU01CX0NPTkYiCiAgICAgICAgZmkKfQoKZnVuY3Rpb24gYWRkX2ZzdGFiX2VudHJ5ICgpIHsKICAgICAgICB2b2xuYW1lPSQxCiAgICAgICAgbW50cHQ9JDIKICAgICAgICBtbnRlbnQ9ImBob3N0bmFtZWA6LyR2b2xuYW1lICRtbnRwdCBnbHVzdGVyZnMgZGVmYXVsdHMsdHJhbnNwb3J0PXRjcCAwIDAiCiAgICAgICAgZXhpc3RzPWBncmVwICJeJG1udGVudCIgL2V0Yy9mc3RhYmAKICAgICAgICBpZiBbICIkZXhpc3RzIiA9PSAiIiBdCiAgICAgICAgdGhlbgogICAgICAgICAgICBlY2hvICIkbW50ZW50IiA+PiAvZXRjL2ZzdGFiCiAgICAgICAgZmkKfQoKcGFyc2VfYXJncyAkQAppZiBbICIkTUVUQSIgPSAiJFZPTCIgXQp0aGVuCiAgICAjZXhwZWN0cyBjdGRiIHNlcnZpY2UgdG8gbWFuYWdlIHNtYgogICAgc2VydmljZSBzbWIgc3RvcAogICAgYWRkX2dsdXN0ZXJmc19jdGRiX29wdGlvbnMKICAgIG1rZGlyIC1wICRDVERCX01OVAogICAgc2xlZXAgNQogICAgbW91bnQgLXQgZ2x1c3RlcmZzIGBob3N0bmFtZWA6JFZPTCAiJENUREJfTU5UIiAmJiBcCiAgICAgICAgYWRkX2ZzdGFiX2VudHJ5ICRWT0wgJENUREJfTU5UCiAgICBjaGtjb25maWcgY3RkYiBvbgpmaQo=, log id: 42b3f7e2 >2014-01-30 06:42:35,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-25) [511b856] FINISH, GetGlusterHookContentVDSCommand, return: IyEvYmluL2Jhc2gKCmtleV92YWxfcGFpcjE9YGVjaG8gJDIgfCBjdXQgLWQgJyAnIC1mIDFgCmtleV92YWxfcGFpcjI9YGVjaG8gJDIgfCBjdXQgLWQgJyAnIC1mIDJgCmtleV92YWxfcGFpcjM9YGVjaG8gJDIgfCBjdXQgLWQgJyAnIC1mIDNgCgprZXk9YGVjaG8gJGtleV92YWxfcGFpcjEgfCBjdXQgLWQgJz0nIC1mIDFgCnZhbD1gZWNobyAka2V5X3ZhbF9wYWlyMSB8IGN1dCAtZCAnPScgLWYgMmAKaWYgWyAiJGtleSIgIT0gImlzX3B1c2hfcGVtIiBdOyB0aGVuCiAgICBleGl0OwpmaQppZiBbICIkdmFsIiAhPSAnMScgXTsgdGhlbgogICAgZXhpdDsKZmkKCmtleT1gZWNobyAka2V5X3ZhbF9wYWlyMiB8IGN1dCAtZCAnPScgLWYgMWAKdmFsPWBlY2hvICRrZXlfdmFsX3BhaXIyIHwgY3V0IC1kICc9JyAtZiAyYAppZiBbICIka2V5IiAhPSAicHViX2ZpbGUiIF07IHRoZW4KICAgIGV4aXQ7CmZpCmlmIFsgIiR2YWwiID09ICIiIF07IHRoZW4KICAgIGV4aXQ7CmZpCnB1Yl9maWxlPWBlY2hvICR2YWxgCnB1Yl9maWxlX3RtcD1gZWNobyAkdmFsYF90bXAKCmtleT1gZWNobyAka2V5X3ZhbF9wYWlyMyB8IGN1dCAtZCAnPScgLWYgMWAKdmFsPWBlY2hvICRrZXlfdmFsX3BhaXIzIHwgY3V0IC1kICc9JyAtZiAyYAppZiBbICIka2V5IiAhPSAic2xhdmVfaXAiIF07IHRoZW4KICAgIGV4aXQ7CmZpCmlmIFsgIiR2YWwiID09ICIiIF07IHRoZW4KICAgIGV4aXQ7CmZpCnNsYXZlX2lwPWBlY2hvICR2YWxgCgppZiBbIC1mICRwdWJfZmlsZSBdOyB0aGVuCiAgICBzY3AgJHB1Yl9maWxlICRzbGF2ZV9pcDokcHViX2ZpbGVfdG1wCiAgICBzc2ggJHNsYXZlX2lwICJtdiAkcHViX2ZpbGVfdG1wICRwdWJfZmlsZSIKICAgIHNzaCAkc2xhdmVfaXAgImdsdXN0ZXIgc3lzdGVtOjogY29weSBmaWxlIC9nZW8tcmVwbGljYXRpb24vY29tbW9uX3NlY3JldC5wZW0ucHViID4gL2Rldi9udWxsIgogICAgc3NoICRzbGF2ZV9pcCAiZ2x1c3RlciBzeXN0ZW06OiBleGVjdXRlIGFkZF9zZWNyZXRfcHViID4gL2Rldi9udWxsIgpmaQo=, log id: 647202fb >2014-01-30 06:42:35,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-45) [511b856] FINISH, GetGlusterHookContentVDSCommand, return: IyEvYmluL2Jhc2gKCiNUaGUgcHJlZmVycmVkIHdheSBvZiBjcmVhdGluZyBhIHNtYiBzaGFyZSBvZiBhIGdsdXN0ZXIgdm9sdW1lIGhhcyBjaGFuZ2VkLgojVGhlIG9sZCBtZXRob2Qgd2FzIHRvIGNyZWF0ZSBhIGZ1c2UgbW91bnQgb2YgdGhlIHZvbHVtZSBhbmQgc2hhcmUgdGhlIG1vdW50CiNwb2ludCB0aHJvdWdoIHNhbWJhLgojCiNOZXcgbWV0aG9kIGVsaW1pbmF0ZXMgdGhlIHJlcXVpcmVtZW50IG9mIGZ1c2UgbW91bnQgYW5kIGNoYW5nZXMgaW4gZnN0YWIuCiNnbHVzdGVyZnNfdmZzIHBsdWdpbiBmb3Igc2FtYmEgbWFrZXMgY2FsbCB0byBsaWJnZmFwaSB0byBhY2Nlc3MgdGhlIHZvbHVtZS4KIwojVGhpcyBob29rIHNjcmlwdCBhdXRvbWFnaWNhbGx5IGNyZWF0ZXMgc2hhcmVzIGZvciB2b2x1bWUgb24gZXZlcnkgdm9sdW1lIHN0YXJ0CiNldmVudCBieSBhZGRpbmcgdGhlIGVudHJpZXMgaW4gc21iLmNvbmYgZmlsZSBhbmQgc2VuZGluZyBTSUdIVVAgdG8gc2FtYmEuCiMKI0luIHNtYi5jb25mOgojZ2x1c3RlcmZzIHZmcyBwbHVnaW4gaGFzIHRvIGJlIHNwZWNpZmllZCBhcyByZXF1aXJlZCB2ZnMgb2JqZWN0LgojUGF0aCB2YWx1ZSBpcyByZWxhdGl2ZSB0byB0aGUgcm9vdCBvZiBnbHVzdGVyIHZvbHVtZTsiLyIgc2lnbmlmaWVzIGNvbXBsZXRlCiN2b2x1bWUuCgpQUk9HTkFNRT0iU3NhbWJhLXN0YXJ0IgpPUFRTUEVDPSJ2b2xuYW1lOiIKVk9MPQoKZnVuY3Rpb24gcGFyc2VfYXJncyAoKSB7CiAgICAgICAgQVJHUz0kKGdldG9wdCAtbCAkT1BUU1BFQyAgLW5hbWUgJFBST0dOQU1FICRAKQogICAgICAgIGV2YWwgc2V0IC0tICIkQVJHUyIKCiAgICAgICAgd2hpbGUgdHJ1ZTsgZG8KICAgICAgICBjYXNlICQxIGluCiAgICAgICAgLS12b2xuYW1lKQogICAgICAgICBzaGlmdAogICAgICAgICBWT0w9JDEKICAgICAgICAgOzsKICAgICAgICAqKQogICAgICAgICBzaGlmdAogICAgICAgICBicmVhawogICAgICAgICA7OwogICAgICAgIGVzYWMKICAgICAgICBzaGlmdAogICAgICAgIGRvbmUKfQoKZnVuY3Rpb24gYWRkX3NhbWJhX3NoYXJlICgpIHsKICAgICAgICB2b2xuYW1lPSQxCiAgICAgICAgU1RSSU5HPSJcbltnbHVzdGVyLSR2b2xuYW1lXVxuIgogICAgICAgIFNUUklORys9ImNvbW1lbnQgPSBGb3Igc2FtYmEgc2hhcmUgb2Ygdm9sdW1lICR2b2xuYW1lXG4iCiAgICAgICAgU1RSSU5HKz0idmZzIG9iamVjdHMgPSBnbHVzdGVyZnNcbiIKICAgICAgICBTVFJJTkcrPSJnbHVzdGVyZnM6dm9sdW1lID0gJHZvbG5hbWVcbiIKICAgICAgICBTVFJJTkcrPSJnbHVzdGVyZnM6bG9nZmlsZSA9IC92YXIvbG9nL3NhbWJhL2dsdXN0ZXJmcy0kdm9sbmFtZS4lJU0ubG9nXG4iCiAgICAgICAgU1RSSU5HKz0iZ2x1c3RlcmZzOmxvZ2xldmVsID0gN1xuIgogICAgICAgIFNUUklORys9InBhdGggPSAvXG4iCiAgICAgICAgU1RSSU5HKz0icmVhZCBvbmx5ID0gbm9cbiIKICAgICAgICBTVFJJTkcrPSJndWVzdCBvayA9IHllc1xuIgogICAgICAgIHByaW50ZiAiJFNUUklORyIgID4+IC9ldGMvc2FtYmEvc21iLmNvbmYKfQoKZnVuY3Rpb24gc2lnaHVwX3NhbWJhICgpIHsKICAgICAgICBwaWQ9YGNhdCAvdmFyL3J1bi9zbWJkLnBpZGAKICAgICAgICBpZiBbICJ4JHBpZCIgIT0gIngiIF0KICAgICAgICB0aGVuCiAgICAgICAgICAgICAgICBraWxsIC1IVVAgIiRwaWQiOwogICAgICAgIGVsc2UKICAgICAgICAgICAgICAgIC9ldGMvaW5pdC5kL3NtYiBjb25kcmVzdGFydAogICAgICAgIGZpCn0KCmZ1bmN0aW9uIGdldF9zbWIgKCkgewogICAgICAgIHZvbG5hbWU9JDEKICAgICAgICB1c2VydmFsdWU9CgogICAgICAgIHVzZXJjaWZzdmFsdWU9JChncmVwIHVzZXIuY2lmcyAvdmFyL2xpYi9nbHVzdGVyZC92b2xzLyIkdm9sbmFtZSIvaW5mbyB8XAogICAgICAgICAgICAgICAgICAgICAgICBjdXQgLWQiPSIgLWYyKQogICAgICAgIHVzZXJzbWJ2YWx1ZT0kKGdyZXAgdXNlci5zbWIgL3Zhci9saWIvZ2x1c3RlcmQvdm9scy8iJHZvbG5hbWUiL2luZm8gfFwKICAgICAgICAgICAgICAgICAgICAgICBjdXQgLWQiPSIgLWYyKQoKICAgICAgICBpZiBbWyAkdXNlcmNpZnN2YWx1ZSA9ICJkaXNhYmxlIiB8fCAkdXNlcnNtYnZhbHVlID0gImRpc2FibGUiIF1dOyB0aGVuCiAgICAgICAgICAgICAgICB1c2VydmFsdWU9ImRpc2FibGUiCiAgICAgICAgZmkKICAgICAgICBlY2hvICIkdXNlcnZhbHVlIgp9CgpwYXJzZV9hcmdzICRACmlmIFsgJChnZXRfc21iICIkVk9MIikgPSAiZGlzYWJsZSIgXTsgdGhlbgogICAgICAgIGV4aXQgMApmaQoKaWYgISBncmVwIC0tcXVpZXQgIlxbZ2x1c3Rlci0kVk9MXF0iIC9ldGMvc2FtYmEvc21iLmNvbmYgOyB0aGVuCiAgICAgICAgYWRkX3NhbWJhX3NoYXJlICRWT0wKICAgICAgICBzaWdodXBfc2FtYmEKZmkK, log id: 720585b8 >2014-01-30 06:42:35,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterHookContentVDSCommand] (pool-5-thread-37) [511b856] FINISH, GetGlusterHookContentVDSCommand, return: IyEgL2Jpbi9iYXNoCgojVGhlIHByZWZlcnJlZCB3YXkgb2YgY3JlYXRpbmcgYSBzbWIgc2hhcmUgb2YgYSBnbHVzdGVyIHZvbHVtZSBoYXMgY2hhbmdlZC4KI1RoZSBvbGQgbWV0aG9kIHdhcyB0byBjcmVhdGUgYSBmdXNlIG1vdW50IG9mIHRoZSB2b2x1bWUgYW5kIHNoYXJlIHRoZSBtb3VudAojcG9pbnQgdGhyb3VnaCBzYW1iYS4KIwojTmV3IG1ldGhvZCBlbGltaW5hdGVzIHRoZSByZXF1aXJlbWVudCBvZiBmdXNlIG1vdW50IGFuZCBjaGFuZ2VzIGluIGZzdGFiLgojZ2x1c3RlcmZzX3ZmcyBwbHVnaW4gZm9yIHNhbWJhIG1ha2VzIGNhbGwgdG8gbGliZ2ZhcGkgdG8gYWNjZXNzIHRoZSB2b2x1bWUuCiMKI1RoaXMgaG9vayBzY3JpcHQgYXV0b21hZ2ljYWxseSByZW1vdmVzIHNoYXJlcyBmb3Igdm9sdW1lIG9uIGV2ZXJ5IHZvbHVtZSBzdG9wCiNldmVudCBieSByZW1vdmluZyB0aGUgdm9sdW1lIHJlbGF0ZWQgZW50cmllcyhpZiBhbnkpIGluIHNtYi5jb25mIGZpbGUuCgpQUk9HTkFNRT0iU3NhbWJhLXN0b3AiCk9QVFNQRUM9InZvbG5hbWU6IgpWT0w9CgpmdW5jdGlvbiBwYXJzZV9hcmdzICgpIHsKICAgICAgICBBUkdTPSQoZ2V0b3B0IC1sICRPUFRTUEVDICAtbmFtZSAkUFJPR05BTUUgJEApCiAgICAgICAgZXZhbCBzZXQgLS0gIiRBUkdTIgoKICAgICAgICB3aGlsZSB0cnVlOyBkbwogICAgICAgIGNhc2UgJDEgaW4KICAgICAgICAtLXZvbG5hbWUpCiAgICAgICAgIHNoaWZ0CiAgICAgICAgIFZPTD0kMQogICAgICAgICA7OwogICAgICAgICopCiAgICAgICAgIHNoaWZ0CiAgICAgICAgIGJyZWFrCiAgICAgICAgIDs7CiAgICAgICAgZXNhYwogICAgICAgIHNoaWZ0CiAgICAgICAgZG9uZQp9CgpmdW5jdGlvbiBkZWxfc2FtYmFfc2hhcmUgKCkgewogICAgICAgIHZvbG5hbWU9JDEKICAgICAgICBzZWQgLWkgIi9cW2dsdXN0ZXItJHZvbG5hbWVcXS8sL14kL2QiIC9ldGMvc2FtYmEvc21iLmNvbmYKfQoKZnVuY3Rpb24gc2lnaHVwX3NhbWJhICgpIHsKICAgICAgICBwaWQ9YGNhdCAvdmFyL3J1bi9zbWJkLnBpZGAKICAgICAgICBpZiBbICJ4JHBpZCIgIT0gIngiIF0KICAgICAgICB0aGVuCiAgICAgICAgICAgICAgICBraWxsIC1IVVAgJHBpZDsKICAgICAgICBlbHNlCiAgICAgICAgICAgICAgICAvZXRjL2luaXQuZC9zbWIgY29uZHJlc3RhcnQKICAgICAgICBmaQp9CgpwYXJzZV9hcmdzICRACmRlbF9zYW1iYV9zaGFyZSAkVk9MCnNpZ2h1cF9zYW1iYQo=, log id: 22df4c3a >2014-01-30 06:42:35,335 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [511b856] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected conflict in hook start-POST-30samba-start.sh.rpmsave of Cluster test_3. >2014-01-30 06:42:35,349 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [511b856] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected conflict in hook set-POST-30samba-set.sh.rpmsave of Cluster test_3. >2014-01-30 06:42:35,359 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-14) [511b856] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Detected conflict in hook add-brick-PRE-28Quota-enable-root-xattr-heal.sh.rpmsave of Cluster test_3. >2014-01-30 06:42:36,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32ceba50 >2014-01-30 06:42:36,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 32ceba50 >2014-01-30 06:42:36,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 45ee0d5d >2014-01-30 06:42:37,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15a8e962, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14501417}, log id: 45ee0d5d >2014-01-30 06:42:37,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4942d200 >2014-01-30 06:42:37,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4942d200 >2014-01-30 06:42:37,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2efc721f >2014-01-30 06:42:38,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2efc721f >2014-01-30 06:42:43,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 772664f >2014-01-30 06:42:43,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 772664f >2014-01-30 06:42:43,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 329064ef >2014-01-30 06:42:43,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ee1983c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d7f9ffe}, log id: 329064ef >2014-01-30 06:42:43,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4c827ed5 >2014-01-30 06:42:44,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4c827ed5 >2014-01-30 06:42:44,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1832d5c0 >2014-01-30 06:42:44,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1832d5c0 >2014-01-30 06:42:49,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e5570be >2014-01-30 06:42:50,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1e5570be >2014-01-30 06:42:50,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 572271a5 >2014-01-30 06:42:50,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52c906fc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9d2d267}, log id: 572271a5 >2014-01-30 06:42:50,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 62ebf5d9 >2014-01-30 06:42:50,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 62ebf5d9 >2014-01-30 06:42:50,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1302cbd4 >2014-01-30 06:42:51,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1302cbd4 >2014-01-30 06:42:56,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c7a4c83 >2014-01-30 06:42:56,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c7a4c83 >2014-01-30 06:42:56,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65696233 >2014-01-30 06:42:56,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19beb929, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7577db1a}, log id: 65696233 >2014-01-30 06:42:56,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6563d17b >2014-01-30 06:42:57,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6563d17b >2014-01-30 06:42:57,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6e526686 >2014-01-30 06:42:57,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e526686 >2014-01-30 06:43:02,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6813588 >2014-01-30 06:43:03,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6813588 >2014-01-30 06:43:03,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9b0207c >2014-01-30 06:43:03,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abee0acb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16b27e5e}, log id: 9b0207c >2014-01-30 06:43:03,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7369a0aa >2014-01-30 06:43:04,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7369a0aa >2014-01-30 06:43:04,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 59d8c463 >2014-01-30 06:43:04,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59d8c463 >2014-01-30 06:43:09,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b21540d >2014-01-30 06:43:09,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1b21540d >2014-01-30 06:43:09,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f1c8d15 >2014-01-30 06:43:10,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9132152d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d7ab7d6}, log id: 4f1c8d15 >2014-01-30 06:43:10,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 610061d7 >2014-01-30 06:43:10,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 610061d7 >2014-01-30 06:43:10,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 35f472ba >2014-01-30 06:43:10,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35f472ba >2014-01-30 06:43:15,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17d93b12 >2014-01-30 06:43:16,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 17d93b12 >2014-01-30 06:43:16,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 127b17e8 >2014-01-30 06:43:16,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5674c378, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df60dbfb}, log id: 127b17e8 >2014-01-30 06:43:16,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4de78aa >2014-01-30 06:43:17,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4de78aa >2014-01-30 06:43:17,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 762bdd4f >2014-01-30 06:43:17,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 762bdd4f >2014-01-30 06:43:22,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43cbde3a >2014-01-30 06:43:22,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43cbde3a >2014-01-30 06:43:22,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 482bbef2 >2014-01-30 06:43:23,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@861dd00a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c84c2d}, log id: 482bbef2 >2014-01-30 06:43:23,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3f4f0e29 >2014-01-30 06:43:23,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3f4f0e29 >2014-01-30 06:43:23,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 237084ea >2014-01-30 06:43:23,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 237084ea >2014-01-30 06:43:26,295 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) [78fb20d6] No up server in cluster >2014-01-30 06:43:26,296 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) [78fb20d6] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:43:26,299 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) [78fb20d6] No up server in cluster >2014-01-30 06:43:26,299 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) [78fb20d6] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:43:26,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 39beb1c0 >2014-01-30 06:43:26,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 39beb1c0 >2014-01-30 06:43:26,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: b38d085 >2014-01-30 06:43:27,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterTasksListVDSCommand, return: [], log id: b38d085 >2014-01-30 06:43:28,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38723b0c >2014-01-30 06:43:29,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 38723b0c >2014-01-30 06:43:29,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ce03e8f >2014-01-30 06:43:29,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c307bacb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0af05fd}, log id: 3ce03e8f >2014-01-30 06:43:29,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3b66c5fa >2014-01-30 06:43:30,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3b66c5fa >2014-01-30 06:43:30,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 78016d8b >2014-01-30 06:43:30,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78016d8b >2014-01-30 06:43:35,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1de403c4 >2014-01-30 06:43:35,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1de403c4 >2014-01-30 06:43:35,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21e1328e >2014-01-30 06:43:36,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@832e2ab8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e19e311}, log id: 21e1328e >2014-01-30 06:43:36,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 380ce78 >2014-01-30 06:43:36,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 380ce78 >2014-01-30 06:43:36,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b9a1259 >2014-01-30 06:43:37,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b9a1259 >2014-01-30 06:43:42,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 57d9bbc2 >2014-01-30 06:43:42,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 57d9bbc2 >2014-01-30 06:43:42,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2addb06d >2014-01-30 06:43:42,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e35e188d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0feb713}, log id: 2addb06d >2014-01-30 06:43:42,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 10ca2a55 >2014-01-30 06:43:43,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 10ca2a55 >2014-01-30 06:43:43,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 669d8682 >2014-01-30 06:43:43,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 669d8682 >2014-01-30 06:43:48,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ec4415b >2014-01-30 06:43:49,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4ec4415b >2014-01-30 06:43:49,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5fe51aa >2014-01-30 06:43:49,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ababe7c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9101ecd}, log id: 5fe51aa >2014-01-30 06:43:49,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 935cf17 >2014-01-30 06:43:49,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 935cf17 >2014-01-30 06:43:49,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7ce06549 >2014-01-30 06:43:50,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ce06549 >2014-01-30 06:43:55,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35fecbc1 >2014-01-30 06:43:55,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 35fecbc1 >2014-01-30 06:43:55,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 97e992 >2014-01-30 06:43:55,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46b522f1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8735d7c}, log id: 97e992 >2014-01-30 06:43:55,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 70bf01d4 >2014-01-30 06:43:56,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 70bf01d4 >2014-01-30 06:43:56,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1b6688e5 >2014-01-30 06:43:56,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b6688e5 >2014-01-30 06:44:01,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65c01e20 >2014-01-30 06:44:02,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 65c01e20 >2014-01-30 06:44:02,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d078c6a >2014-01-30 06:44:02,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d24431cc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@704669fb}, log id: 4d078c6a >2014-01-30 06:44:02,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 51da8d8a >2014-01-30 06:44:02,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 51da8d8a >2014-01-30 06:44:02,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 27dcccde >2014-01-30 06:44:03,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27dcccde >2014-01-30 06:44:08,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54fd430f >2014-01-30 06:44:08,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 54fd430f >2014-01-30 06:44:08,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48ada594 >2014-01-30 06:44:08,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7cfa203, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7b30aaf}, log id: 48ada594 >2014-01-30 06:44:08,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 539b80c9 >2014-01-30 06:44:09,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 539b80c9 >2014-01-30 06:44:09,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 55ac5939 >2014-01-30 06:44:09,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55ac5939 >2014-01-30 06:44:14,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 752c59ec >2014-01-30 06:44:15,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 752c59ec >2014-01-30 06:44:15,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: aabb728 >2014-01-30 06:44:15,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b395fc74, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7964fcc}, log id: aabb728 >2014-01-30 06:44:15,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4fec462f >2014-01-30 06:44:16,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4fec462f >2014-01-30 06:44:16,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 22725a6e >2014-01-30 06:44:16,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22725a6e >2014-01-30 06:44:21,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ff3842c >2014-01-30 06:44:21,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1ff3842c >2014-01-30 06:44:21,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 561c3a9f >2014-01-30 06:44:22,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4e99f29, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3113fd88}, log id: 561c3a9f >2014-01-30 06:44:22,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d3d9ce6 >2014-01-30 06:44:22,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7d3d9ce6 >2014-01-30 06:44:22,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2a0201ad >2014-01-30 06:44:22,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a0201ad >2014-01-30 06:44:27,131 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-14) [511b856] No up server in cluster >2014-01-30 06:44:27,132 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:44:27,135 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-14) [511b856] No up server in cluster >2014-01-30 06:44:27,135 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:44:27,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 28640015 >2014-01-30 06:44:27,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 28640015 >2014-01-30 06:44:27,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 5690ca0e >2014-01-30 06:44:27,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14cdeab5 >2014-01-30 06:44:27,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterTasksListVDSCommand, return: [], log id: 5690ca0e >2014-01-30 06:44:28,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 14cdeab5 >2014-01-30 06:44:28,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a3fd583 >2014-01-30 06:44:28,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bdeeb75, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f780f7e6}, log id: 3a3fd583 >2014-01-30 06:44:28,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 31bd74af >2014-01-30 06:44:29,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 31bd74af >2014-01-30 06:44:29,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6b9b9ab7 >2014-01-30 06:44:29,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b9b9ab7 >2014-01-30 06:44:34,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e3f056e >2014-01-30 06:44:34,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1e3f056e >2014-01-30 06:44:34,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20c09e58 >2014-01-30 06:44:35,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f613905, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@273671bd}, log id: 20c09e58 >2014-01-30 06:44:35,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2db6a43 >2014-01-30 06:44:35,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2db6a43 >2014-01-30 06:44:35,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 236bdb58 >2014-01-30 06:44:35,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 236bdb58 >2014-01-30 06:44:40,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c93e6c8 >2014-01-30 06:44:41,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3c93e6c8 >2014-01-30 06:44:41,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48f5a763 >2014-01-30 06:44:41,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c199266, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0a5a605}, log id: 48f5a763 >2014-01-30 06:44:41,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4bf2b155 >2014-01-30 06:44:42,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4bf2b155 >2014-01-30 06:44:42,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 762e28ac >2014-01-30 06:44:42,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 762e28ac >2014-01-30 06:44:47,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11daa0bd >2014-01-30 06:44:47,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 11daa0bd >2014-01-30 06:44:47,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48e5a1d3 >2014-01-30 06:44:48,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a7b183a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6f4a8bb}, log id: 48e5a1d3 >2014-01-30 06:44:48,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 36e90c6d >2014-01-30 06:44:48,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 36e90c6d >2014-01-30 06:44:48,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6fb4e613 >2014-01-30 06:44:48,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fb4e613 >2014-01-30 06:44:54,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c439051 >2014-01-30 06:44:54,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2c439051 >2014-01-30 06:44:54,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 260dc254 >2014-01-30 06:44:54,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@918f9bd5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4095d22d}, log id: 260dc254 >2014-01-30 06:44:54,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d7e4cf5 >2014-01-30 06:44:55,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7d7e4cf5 >2014-01-30 06:44:55,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2065049d >2014-01-30 06:44:55,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2065049d >2014-01-30 06:45:00,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1fc52ea8 >2014-01-30 06:45:01,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1fc52ea8 >2014-01-30 06:45:01,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38955864 >2014-01-30 06:45:01,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fb43b29, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93286fc}, log id: 38955864 >2014-01-30 06:45:01,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 386295d0 >2014-01-30 06:45:01,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 386295d0 >2014-01-30 06:45:01,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7fdd319c >2014-01-30 06:45:02,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fdd319c >2014-01-30 06:45:07,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d80ca22 >2014-01-30 06:45:07,304 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-76) [5b01de2c] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 06:45:07,432 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-76) [5b01de2c] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 06:45:07,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1d80ca22 >2014-01-30 06:45:07,649 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-76) [5b01de2c] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 06:45:07,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16cc1ba3 >2014-01-30 06:45:07,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@926b40ca, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f625d32a}, log id: 16cc1ba3 >2014-01-30 06:45:07,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 491c54d4 >2014-01-30 06:45:07,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 16fed963 >2014-01-30 06:45:08,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@bf2fdfb, log id: 491c54d4 >2014-01-30 06:45:08,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 7e006fdd >2014-01-30 06:45:08,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 16fed963 >2014-01-30 06:45:08,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: eb4c077 >2014-01-30 06:45:08,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3d464c47, log id: 7e006fdd >2014-01-30 06:45:08,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: eb4c077 >2014-01-30 06:45:13,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7709a0ff >2014-01-30 06:45:14,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7709a0ff >2014-01-30 06:45:14,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d8352d2 >2014-01-30 06:45:14,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fd17cd0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2199292c}, log id: 7d8352d2 >2014-01-30 06:45:14,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 62ec031d >2014-01-30 06:45:15,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 62ec031d >2014-01-30 06:45:15,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2279d455 >2014-01-30 06:45:15,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2279d455 >2014-01-30 06:45:20,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ef49ca7 >2014-01-30 06:45:20,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7ef49ca7 >2014-01-30 06:45:20,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 28f4c6fb >2014-01-30 06:45:21,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1500086b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b5c31a0}, log id: 28f4c6fb >2014-01-30 06:45:21,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6474cc02 >2014-01-30 06:45:21,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6474cc02 >2014-01-30 06:45:21,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77eb34a >2014-01-30 06:45:21,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77eb34a >2014-01-30 06:45:26,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7086b0e6 >2014-01-30 06:45:27,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7086b0e6 >2014-01-30 06:45:27,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2aaf2f7f >2014-01-30 06:45:27,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef4a21e0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6476c41a}, log id: 2aaf2f7f >2014-01-30 06:45:27,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 59c5daa1 >2014-01-30 06:45:27,928 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-54) [2214a5ea] No up server in cluster >2014-01-30 06:45:27,929 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:45:27,932 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-54) [2214a5ea] No up server in cluster >2014-01-30 06:45:27,932 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:45:27,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 22048ac2 >2014-01-30 06:45:28,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 59c5daa1 >2014-01-30 06:45:28,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d168dbd >2014-01-30 06:45:28,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d168dbd >2014-01-30 06:45:28,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 22048ac2 >2014-01-30 06:45:28,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 215656e8 >2014-01-30 06:45:28,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterTasksListVDSCommand, return: [], log id: 215656e8 >2014-01-30 06:45:33,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b6ad3b1 >2014-01-30 06:45:33,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6b6ad3b1 >2014-01-30 06:45:33,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ebedf60 >2014-01-30 06:45:34,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6616d4ef, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@edf00839}, log id: 4ebedf60 >2014-01-30 06:45:34,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 58ce978c >2014-01-30 06:45:34,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 58ce978c >2014-01-30 06:45:34,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4efa8e3f >2014-01-30 06:45:34,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4efa8e3f >2014-01-30 06:45:39,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 643e1761 >2014-01-30 06:45:40,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 643e1761 >2014-01-30 06:45:40,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4fc2f2aa >2014-01-30 06:45:40,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7351f9b9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@870e0162}, log id: 4fc2f2aa >2014-01-30 06:45:40,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4dadcb4c >2014-01-30 06:45:41,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4dadcb4c >2014-01-30 06:45:41,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6dbe7225 >2014-01-30 06:45:41,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6dbe7225 >2014-01-30 06:45:46,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3cbc116e >2014-01-30 06:45:47,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3cbc116e >2014-01-30 06:45:47,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a0d6d66 >2014-01-30 06:45:47,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b41cd62f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@992107b2}, log id: 7a0d6d66 >2014-01-30 06:45:47,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2787214a >2014-01-30 06:45:47,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2787214a >2014-01-30 06:45:47,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 32484849 >2014-01-30 06:45:48,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32484849 >2014-01-30 06:45:53,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43575a3a >2014-01-30 06:45:53,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43575a3a >2014-01-30 06:45:53,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ba2c4c >2014-01-30 06:45:53,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ea39896, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a515dd8a}, log id: 3ba2c4c >2014-01-30 06:45:53,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a75461b >2014-01-30 06:45:54,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7a75461b >2014-01-30 06:45:54,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 12514aa0 >2014-01-30 06:45:54,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12514aa0 >2014-01-30 06:45:59,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 740c29f3 >2014-01-30 06:46:00,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 740c29f3 >2014-01-30 06:46:00,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: cf1b3ac >2014-01-30 06:46:00,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce973ed9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92460c46}, log id: cf1b3ac >2014-01-30 06:46:00,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3c74ab85 >2014-01-30 06:46:00,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3c74ab85 >2014-01-30 06:46:00,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 576aba4d >2014-01-30 06:46:01,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 576aba4d >2014-01-30 06:46:06,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36d32698 >2014-01-30 06:46:06,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 36d32698 >2014-01-30 06:46:06,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e9cc834 >2014-01-30 06:46:06,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60aca401, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f6a9ffd}, log id: 5e9cc834 >2014-01-30 06:46:07,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1f9a9bfb >2014-01-30 06:46:07,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1f9a9bfb >2014-01-30 06:46:07,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5dbe9643 >2014-01-30 06:46:07,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5dbe9643 >2014-01-30 06:46:12,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 217a2171 >2014-01-30 06:46:13,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 217a2171 >2014-01-30 06:46:13,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 724726e6 >2014-01-30 06:46:13,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55512294, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8543781b}, log id: 724726e6 >2014-01-30 06:46:13,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 47d1ba90 >2014-01-30 06:46:14,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 47d1ba90 >2014-01-30 06:46:14,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4482505b >2014-01-30 06:46:14,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4482505b >2014-01-30 06:46:19,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2170fa09 >2014-01-30 06:46:19,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2170fa09 >2014-01-30 06:46:19,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2091aeb5 >2014-01-30 06:46:20,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c2cc3ed, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a4b3b5c}, log id: 2091aeb5 >2014-01-30 06:46:20,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6eb5adc5 >2014-01-30 06:46:20,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6eb5adc5 >2014-01-30 06:46:20,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 700b1c4d >2014-01-30 06:46:20,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 700b1c4d >2014-01-30 06:46:25,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 267db46e >2014-01-30 06:46:26,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 267db46e >2014-01-30 06:46:26,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2826baa9 >2014-01-30 06:46:26,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67432640, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5fa6af}, log id: 2826baa9 >2014-01-30 06:46:26,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7990971e >2014-01-30 06:46:27,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7990971e >2014-01-30 06:46:27,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ec299 >2014-01-30 06:46:27,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ec299 >2014-01-30 06:46:28,726 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-24) [3310e3f9] No up server in cluster >2014-01-30 06:46:28,727 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-24) [3310e3f9] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:46:28,729 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-24) [3310e3f9] No up server in cluster >2014-01-30 06:46:28,730 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-24) [3310e3f9] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:46:28,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 74548d0d >2014-01-30 06:46:29,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 74548d0d >2014-01-30 06:46:29,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 2e9322e6 >2014-01-30 06:46:29,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterTasksListVDSCommand, return: [], log id: 2e9322e6 >2014-01-30 06:46:32,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3001217b >2014-01-30 06:46:32,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3001217b >2014-01-30 06:46:32,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 286e442e >2014-01-30 06:46:33,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@759b1069, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3ac1b03}, log id: 286e442e >2014-01-30 06:46:33,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 24098b75 >2014-01-30 06:46:33,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 24098b75 >2014-01-30 06:46:33,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 45a5eeb7 >2014-01-30 06:46:33,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45a5eeb7 >2014-01-30 06:46:39,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d9e5d0b >2014-01-30 06:46:39,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4d9e5d0b >2014-01-30 06:46:39,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 412ba4a6 >2014-01-30 06:46:39,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1746a148, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bba1101a}, log id: 412ba4a6 >2014-01-30 06:46:39,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 43646990 >2014-01-30 06:46:40,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 43646990 >2014-01-30 06:46:40,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2617b55f >2014-01-30 06:46:40,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2617b55f >2014-01-30 06:46:45,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3cca6d67 >2014-01-30 06:46:46,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3cca6d67 >2014-01-30 06:46:46,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 367a4afa >2014-01-30 06:46:46,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@757044d8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@568398f7}, log id: 367a4afa >2014-01-30 06:46:46,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 60faf709 >2014-01-30 06:46:46,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 60faf709 >2014-01-30 06:46:46,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5212de28 >2014-01-30 06:46:47,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5212de28 >2014-01-30 06:46:52,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44cd3e65 >2014-01-30 06:46:52,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 44cd3e65 >2014-01-30 06:46:52,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14a5f6e >2014-01-30 06:46:52,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6792edd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f38e61f}, log id: 14a5f6e >2014-01-30 06:46:52,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6af7ea07 >2014-01-30 06:46:53,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6af7ea07 >2014-01-30 06:46:53,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 368f0903 >2014-01-30 06:46:53,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 368f0903 >2014-01-30 06:46:58,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10325be5 >2014-01-30 06:46:59,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 10325be5 >2014-01-30 06:46:59,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e6e2b21 >2014-01-30 06:46:59,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17dd2db1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@891a53cc}, log id: 5e6e2b21 >2014-01-30 06:46:59,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: f767d7b >2014-01-30 06:46:59,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: f767d7b >2014-01-30 06:46:59,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1ed9a2fd >2014-01-30 06:47:00,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ed9a2fd >2014-01-30 06:47:05,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6753b90f >2014-01-30 06:47:05,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6753b90f >2014-01-30 06:47:05,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50d4a6b6 >2014-01-30 06:47:06,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bbb4bef, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f4156ca}, log id: 50d4a6b6 >2014-01-30 06:47:06,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c9f51cf >2014-01-30 06:47:06,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5c9f51cf >2014-01-30 06:47:06,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6323bfc5 >2014-01-30 06:47:06,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6323bfc5 >2014-01-30 06:47:11,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e88f797 >2014-01-30 06:47:12,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e88f797 >2014-01-30 06:47:12,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7280df39 >2014-01-30 06:47:12,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd3c6f26, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@852b5eff}, log id: 7280df39 >2014-01-30 06:47:12,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6689c290 >2014-01-30 06:47:13,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6689c290 >2014-01-30 06:47:13,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 72913c25 >2014-01-30 06:47:13,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72913c25 >2014-01-30 06:47:18,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d3386bd >2014-01-30 06:47:18,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4d3386bd >2014-01-30 06:47:18,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 773cbada >2014-01-30 06:47:19,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d03a09e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d474680}, log id: 773cbada >2014-01-30 06:47:19,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2e812cf7 >2014-01-30 06:47:19,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2e812cf7 >2014-01-30 06:47:19,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4c42112a >2014-01-30 06:47:19,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c42112a >2014-01-30 06:47:25,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29900ec8 >2014-01-30 06:47:25,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 29900ec8 >2014-01-30 06:47:25,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e4d1bdf >2014-01-30 06:47:25,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13aabe18, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81caa21a}, log id: 3e4d1bdf >2014-01-30 06:47:25,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 71d4780c >2014-01-30 06:47:26,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 71d4780c >2014-01-30 06:47:26,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 385e0622 >2014-01-30 06:47:26,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 385e0622 >2014-01-30 06:47:29,520 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] No up server in cluster >2014-01-30 06:47:29,520 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:47:29,523 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] No up server in cluster >2014-01-30 06:47:29,524 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:47:29,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c7c4d39 >2014-01-30 06:47:30,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4c7c4d39 >2014-01-30 06:47:30,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4b37803c >2014-01-30 06:47:30,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterTasksListVDSCommand, return: [], log id: 4b37803c >2014-01-30 06:47:31,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e41211 >2014-01-30 06:47:32,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1e41211 >2014-01-30 06:47:32,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f1246ec >2014-01-30 06:47:32,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6019389, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53ce03ef}, log id: 2f1246ec >2014-01-30 06:47:32,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 207b0cc9 >2014-01-30 06:47:32,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 207b0cc9 >2014-01-30 06:47:32,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 68bb0dce >2014-01-30 06:47:33,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68bb0dce >2014-01-30 06:47:38,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 545aa4ca >2014-01-30 06:47:38,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 545aa4ca >2014-01-30 06:47:38,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5efbc9e1 >2014-01-30 06:47:38,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@680e74df, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eee428ce}, log id: 5efbc9e1 >2014-01-30 06:47:38,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6bd7d1f >2014-01-30 06:47:39,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6bd7d1f >2014-01-30 06:47:39,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 141beba8 >2014-01-30 06:47:39,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 141beba8 >2014-01-30 06:47:44,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4100d3f7 >2014-01-30 06:47:45,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4100d3f7 >2014-01-30 06:47:45,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12fbb493 >2014-01-30 06:47:45,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@809457c1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41363aed}, log id: 12fbb493 >2014-01-30 06:47:45,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7bb7fafa >2014-01-30 06:47:45,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7bb7fafa >2014-01-30 06:47:45,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 10ce3414 >2014-01-30 06:47:46,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10ce3414 >2014-01-30 06:47:51,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1621e65c >2014-01-30 06:47:51,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1621e65c >2014-01-30 06:47:51,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 212ee3fa >2014-01-30 06:47:52,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75822818, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23e30c84}, log id: 212ee3fa >2014-01-30 06:47:52,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5e8c7a57 >2014-01-30 06:47:52,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5e8c7a57 >2014-01-30 06:47:52,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2c9858a2 >2014-01-30 06:47:52,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c9858a2 >2014-01-30 06:47:57,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1967411e >2014-01-30 06:47:58,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1967411e >2014-01-30 06:47:58,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c8d77d3 >2014-01-30 06:47:58,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe2c9fee, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6081fc1a}, log id: 5c8d77d3 >2014-01-30 06:47:58,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 35776ad5 >2014-01-30 06:47:59,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 35776ad5 >2014-01-30 06:47:59,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1803fe30 >2014-01-30 06:47:59,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1803fe30 >2014-01-30 06:48:04,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2393d525 >2014-01-30 06:48:04,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2393d525 >2014-01-30 06:48:04,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11447bf5 >2014-01-30 06:48:05,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32e9568, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ddf14ade}, log id: 11447bf5 >2014-01-30 06:48:05,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 54581d2c >2014-01-30 06:48:05,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 54581d2c >2014-01-30 06:48:05,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 66f35982 >2014-01-30 06:48:05,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 66f35982 >2014-01-30 06:48:10,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5bb695d5 >2014-01-30 06:48:11,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5bb695d5 >2014-01-30 06:48:11,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2994a8c0 >2014-01-30 06:48:11,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74184c3c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cac40f7}, log id: 2994a8c0 >2014-01-30 06:48:11,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 49e13985 >2014-01-30 06:48:12,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 49e13985 >2014-01-30 06:48:12,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5912cd82 >2014-01-30 06:48:12,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5912cd82 >2014-01-30 06:48:17,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a3d51cd >2014-01-30 06:48:18,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a3d51cd >2014-01-30 06:48:18,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 279fb130 >2014-01-30 06:48:18,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de764a43, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4826bfdc}, log id: 279fb130 >2014-01-30 06:48:18,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b16c1fb >2014-01-30 06:48:18,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2b16c1fb >2014-01-30 06:48:18,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6af2a371 >2014-01-30 06:48:19,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6af2a371 >2014-01-30 06:48:24,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c2f7429 >2014-01-30 06:48:24,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c2f7429 >2014-01-30 06:48:24,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2131caf1 >2014-01-30 06:48:24,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@daed7ab1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47d016bf}, log id: 2131caf1 >2014-01-30 06:48:24,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ca329c7 >2014-01-30 06:48:25,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3ca329c7 >2014-01-30 06:48:25,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 316082f8 >2014-01-30 06:48:25,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 316082f8 >2014-01-30 06:48:30,367 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) [5049497] No up server in cluster >2014-01-30 06:48:30,367 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) [5049497] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:48:30,370 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) [5049497] No up server in cluster >2014-01-30 06:48:30,370 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) [5049497] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:48:30,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4faa2615 >2014-01-30 06:48:30,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7dd10bb2 >2014-01-30 06:48:30,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4faa2615 >2014-01-30 06:48:30,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 5853a133 >2014-01-30 06:48:31,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7dd10bb2 >2014-01-30 06:48:31,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5491630e >2014-01-30 06:48:31,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterTasksListVDSCommand, return: [], log id: 5853a133 >2014-01-30 06:48:31,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5ba4935, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c90f5dd4}, log id: 5491630e >2014-01-30 06:48:31,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1e7d7b22 >2014-01-30 06:48:31,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1e7d7b22 >2014-01-30 06:48:31,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 67f7d026 >2014-01-30 06:48:32,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67f7d026 >2014-01-30 06:48:37,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59439c43 >2014-01-30 06:48:37,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 59439c43 >2014-01-30 06:48:37,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e01c7a2 >2014-01-30 06:48:38,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6be44dc4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdda7c54}, log id: e01c7a2 >2014-01-30 06:48:38,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 26e15e0e >2014-01-30 06:48:38,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 26e15e0e >2014-01-30 06:48:38,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1e90d9b6 >2014-01-30 06:48:38,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e90d9b6 >2014-01-30 06:48:43,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 620c5afe >2014-01-30 06:48:44,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 620c5afe >2014-01-30 06:48:44,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 644f7834 >2014-01-30 06:48:44,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ddeee0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5858be8}, log id: 644f7834 >2014-01-30 06:48:44,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 58fee557 >2014-01-30 06:48:45,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 58fee557 >2014-01-30 06:48:45,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 62bba10b >2014-01-30 06:48:45,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62bba10b >2014-01-30 06:48:50,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 401d9b5c >2014-01-30 06:48:50,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 401d9b5c >2014-01-30 06:48:50,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26edabb3 >2014-01-30 06:48:51,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a27ab297, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8652099}, log id: 26edabb3 >2014-01-30 06:48:51,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4aaf622a >2014-01-30 06:48:51,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4aaf622a >2014-01-30 06:48:51,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4a858a36 >2014-01-30 06:48:51,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a858a36 >2014-01-30 06:48:56,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c3f220e >2014-01-30 06:48:57,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2c3f220e >2014-01-30 06:48:57,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6edb8d43 >2014-01-30 06:48:57,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7319fdf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77ff8661}, log id: 6edb8d43 >2014-01-30 06:48:57,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 58cff17b >2014-01-30 06:48:58,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 58cff17b >2014-01-30 06:48:58,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2920ade9 >2014-01-30 06:48:58,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2920ade9 >2014-01-30 06:49:03,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b6752fb >2014-01-30 06:49:03,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4b6752fb >2014-01-30 06:49:03,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1899edf9 >2014-01-30 06:49:04,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b807075, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec9f0ecc}, log id: 1899edf9 >2014-01-30 06:49:04,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1d4b8c28 >2014-01-30 06:49:04,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1d4b8c28 >2014-01-30 06:49:04,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5434f6a0 >2014-01-30 06:49:05,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5434f6a0 >2014-01-30 06:49:10,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23860a0 >2014-01-30 06:49:10,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 23860a0 >2014-01-30 06:49:10,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ac79839 >2014-01-30 06:49:10,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@232e5d79, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36a8974e}, log id: ac79839 >2014-01-30 06:49:10,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 555a2a42 >2014-01-30 06:49:11,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 555a2a42 >2014-01-30 06:49:11,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: bac325 >2014-01-30 06:49:11,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: bac325 >2014-01-30 06:49:16,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6fbcb6f8 >2014-01-30 06:49:17,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6fbcb6f8 >2014-01-30 06:49:17,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 34d2d506 >2014-01-30 06:49:17,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fdec1a27, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a6be37e}, log id: 34d2d506 >2014-01-30 06:49:17,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3843c448 >2014-01-30 06:49:17,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3843c448 >2014-01-30 06:49:17,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 662a42da >2014-01-30 06:49:18,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 662a42da >2014-01-30 06:49:23,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48fbe69 >2014-01-30 06:49:23,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 48fbe69 >2014-01-30 06:49:23,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d45ebf9 >2014-01-30 06:49:23,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c84ea2bb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9b61869}, log id: 1d45ebf9 >2014-01-30 06:49:23,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 62afb1ec >2014-01-30 06:49:24,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 62afb1ec >2014-01-30 06:49:24,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5aa2a335 >2014-01-30 06:49:24,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5aa2a335 >2014-01-30 06:49:29,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 47ca447f >2014-01-30 06:49:30,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 47ca447f >2014-01-30 06:49:30,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f15d320 >2014-01-30 06:49:30,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af446551, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c37cc5e9}, log id: 7f15d320 >2014-01-30 06:49:30,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 28692a9 >2014-01-30 06:49:30,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 28692a9 >2014-01-30 06:49:30,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7672d872 >2014-01-30 06:49:31,242 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) [3472ce94] No up server in cluster >2014-01-30 06:49:31,242 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) [3472ce94] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:49:31,245 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) [3472ce94] No up server in cluster >2014-01-30 06:49:31,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7672d872 >2014-01-30 06:49:31,245 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) [3472ce94] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:49:31,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5eef9a97 >2014-01-30 06:49:31,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 5eef9a97 >2014-01-30 06:49:31,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 4fcc255a >2014-01-30 06:49:32,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterTasksListVDSCommand, return: [], log id: 4fcc255a >2014-01-30 06:49:36,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6bf5c835 >2014-01-30 06:49:36,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6bf5c835 >2014-01-30 06:49:36,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30984163 >2014-01-30 06:49:37,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32e2e14c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91396a94}, log id: 30984163 >2014-01-30 06:49:37,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: aa45e16 >2014-01-30 06:49:37,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: aa45e16 >2014-01-30 06:49:37,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2f8f47c >2014-01-30 06:49:37,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f8f47c >2014-01-30 06:49:42,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67a5fc42 >2014-01-30 06:49:43,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 67a5fc42 >2014-01-30 06:49:43,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31c69178 >2014-01-30 06:49:43,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfa7fe25, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3dd313e8}, log id: 31c69178 >2014-01-30 06:49:43,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: f54fa0 >2014-01-30 06:49:44,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: f54fa0 >2014-01-30 06:49:44,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7ed50a98 >2014-01-30 06:49:44,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ed50a98 >2014-01-30 06:49:49,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b78a3e5 >2014-01-30 06:49:49,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1b78a3e5 >2014-01-30 06:49:49,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e60bbb6 >2014-01-30 06:49:50,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40b90fc7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6cd85cf3}, log id: 5e60bbb6 >2014-01-30 06:49:50,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1db0bf0b >2014-01-30 06:49:50,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1db0bf0b >2014-01-30 06:49:50,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65108aad >2014-01-30 06:49:50,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65108aad >2014-01-30 06:49:55,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30988ed5 >2014-01-30 06:49:56,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 30988ed5 >2014-01-30 06:49:56,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b424b0f >2014-01-30 06:49:56,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7260abb4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be33ea6b}, log id: 7b424b0f >2014-01-30 06:49:56,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1b96da7d >2014-01-30 06:49:57,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1b96da7d >2014-01-30 06:49:57,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 54a744ee >2014-01-30 06:49:57,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54a744ee >2014-01-30 06:50:02,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b209f0a >2014-01-30 06:50:03,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: b209f0a >2014-01-30 06:50:03,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 171e2c12 >2014-01-30 06:50:03,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@931443b2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a8de594}, log id: 171e2c12 >2014-01-30 06:50:03,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 61f98560 >2014-01-30 06:50:03,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 61f98560 >2014-01-30 06:50:03,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 11adf981 >2014-01-30 06:50:04,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 11adf981 >2014-01-30 06:50:08,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 3406776c >2014-01-30 06:50:08,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1c17d491, log id: 3406776c >2014-01-30 06:50:08,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 608489ff >2014-01-30 06:50:09,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@265c256e, log id: 608489ff >2014-01-30 06:50:09,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2fb5463 >2014-01-30 06:50:09,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2fb5463 >2014-01-30 06:50:09,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6360f137 >2014-01-30 06:50:09,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65416ed2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1610f900}, log id: 6360f137 >2014-01-30 06:50:09,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6fe23de2 >2014-01-30 06:50:10,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6fe23de2 >2014-01-30 06:50:10,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1916f6d4 >2014-01-30 06:50:10,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1916f6d4 >2014-01-30 06:50:15,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 62b0b663 >2014-01-30 06:50:16,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 62b0b663 >2014-01-30 06:50:16,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 234425d3 >2014-01-30 06:50:16,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bcf334a4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@690f9173}, log id: 234425d3 >2014-01-30 06:50:16,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 35e3785e >2014-01-30 06:50:16,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 35e3785e >2014-01-30 06:50:16,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6c9790b3 >2014-01-30 06:50:17,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c9790b3 >2014-01-30 06:50:22,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6abd78f9 >2014-01-30 06:50:22,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6abd78f9 >2014-01-30 06:50:22,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6dbdf12e >2014-01-30 06:50:23,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4605c690, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bad5127c}, log id: 6dbdf12e >2014-01-30 06:50:23,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 582a509e >2014-01-30 06:50:23,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 582a509e >2014-01-30 06:50:23,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3787a15 >2014-01-30 06:50:23,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3787a15 >2014-01-30 06:50:28,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50610a1a >2014-01-30 06:50:29,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 50610a1a >2014-01-30 06:50:29,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 70fb5c1c >2014-01-30 06:50:29,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@310b46f7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b0a3859}, log id: 70fb5c1c >2014-01-30 06:50:29,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 52ee12e5 >2014-01-30 06:50:30,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 52ee12e5 >2014-01-30 06:50:30,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 62a78231 >2014-01-30 06:50:30,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62a78231 >2014-01-30 06:50:32,068 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) [4376cca4] No up server in cluster >2014-01-30 06:50:32,068 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) [4376cca4] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:50:32,071 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) [4376cca4] No up server in cluster >2014-01-30 06:50:32,071 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) [4376cca4] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:50:32,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 1078d4b5 >2014-01-30 06:50:32,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 1078d4b5 >2014-01-30 06:50:32,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 79d9de07 >2014-01-30 06:50:32,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterTasksListVDSCommand, return: [], log id: 79d9de07 >2014-01-30 06:50:35,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a427c2c >2014-01-30 06:50:35,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5a427c2c >2014-01-30 06:50:35,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24cf4e04 >2014-01-30 06:50:36,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7e49593, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16184ffa}, log id: 24cf4e04 >2014-01-30 06:50:36,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 14c50c5e >2014-01-30 06:50:36,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 14c50c5e >2014-01-30 06:50:36,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 517fef0 >2014-01-30 06:50:36,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 517fef0 >2014-01-30 06:50:41,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7db678eb >2014-01-30 06:50:42,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7db678eb >2014-01-30 06:50:42,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2502aa8e >2014-01-30 06:50:42,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15aa1eb5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10601a85}, log id: 2502aa8e >2014-01-30 06:50:42,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 75ae650a >2014-01-30 06:50:43,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 75ae650a >2014-01-30 06:50:43,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4435b3a5 >2014-01-30 06:50:43,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4435b3a5 >2014-01-30 06:50:48,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3074fc47 >2014-01-30 06:50:48,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3074fc47 >2014-01-30 06:50:48,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31e4a6e5 >2014-01-30 06:50:49,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9eb770ba, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4de876c9}, log id: 31e4a6e5 >2014-01-30 06:50:49,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3f8f0d5a >2014-01-30 06:50:49,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3f8f0d5a >2014-01-30 06:50:49,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 722aab4b >2014-01-30 06:50:50,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 722aab4b >2014-01-30 06:50:55,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ae69c1a >2014-01-30 06:50:55,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5ae69c1a >2014-01-30 06:50:55,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1cf0e083 >2014-01-30 06:50:55,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@821693a4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c606571a}, log id: 1cf0e083 >2014-01-30 06:50:55,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 666e16e1 >2014-01-30 06:50:56,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 666e16e1 >2014-01-30 06:50:56,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 10aafad3 >2014-01-30 06:50:56,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 10aafad3 >2014-01-30 06:51:01,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e9054df >2014-01-30 06:51:02,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3e9054df >2014-01-30 06:51:02,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c088812 >2014-01-30 06:51:02,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9629f2ef, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ccbc486}, log id: 7c088812 >2014-01-30 06:51:02,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5211bb34 >2014-01-30 06:51:02,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5211bb34 >2014-01-30 06:51:02,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 778b384e >2014-01-30 06:51:03,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 778b384e >2014-01-30 06:51:08,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68eede61 >2014-01-30 06:51:08,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 68eede61 >2014-01-30 06:51:08,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d65d0d0 >2014-01-30 06:51:08,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@867ebca0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7131d22f}, log id: 1d65d0d0 >2014-01-30 06:51:08,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6256a483 >2014-01-30 06:51:09,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6256a483 >2014-01-30 06:51:09,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5770f93 >2014-01-30 06:51:09,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5770f93 >2014-01-30 06:51:14,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 625c175f >2014-01-30 06:51:15,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 625c175f >2014-01-30 06:51:15,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c44a19d >2014-01-30 06:51:15,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b847afd6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26538fec}, log id: 5c44a19d >2014-01-30 06:51:15,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 27ec1234 >2014-01-30 06:51:15,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 27ec1234 >2014-01-30 06:51:15,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 347222d1 >2014-01-30 06:51:16,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 347222d1 >2014-01-30 06:51:21,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a13a06f >2014-01-30 06:51:21,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1a13a06f >2014-01-30 06:51:21,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69c6c75 >2014-01-30 06:51:21,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2feb0e7e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ec368f5}, log id: 69c6c75 >2014-01-30 06:51:21,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 10ad5cad >2014-01-30 06:51:22,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 10ad5cad >2014-01-30 06:51:22,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6f1df757 >2014-01-30 06:51:22,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f1df757 >2014-01-30 06:51:27,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 487b41e0 >2014-01-30 06:51:28,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 487b41e0 >2014-01-30 06:51:28,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6003e53d >2014-01-30 06:51:28,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f54cd8f8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0f2e80c}, log id: 6003e53d >2014-01-30 06:51:28,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 8ca5bcb >2014-01-30 06:51:29,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 8ca5bcb >2014-01-30 06:51:29,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 493defb2 >2014-01-30 06:51:29,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 493defb2 >2014-01-30 06:51:32,912 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] No up server in cluster >2014-01-30 06:51:32,912 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:51:32,915 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] No up server in cluster >2014-01-30 06:51:32,915 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:51:32,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 712e66d4 >2014-01-30 06:51:33,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 712e66d4 >2014-01-30 06:51:33,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7113cf3e >2014-01-30 06:51:33,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterTasksListVDSCommand, return: [], log id: 7113cf3e >2014-01-30 06:51:34,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c6d3b60 >2014-01-30 06:51:34,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2c6d3b60 >2014-01-30 06:51:34,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d757ed5 >2014-01-30 06:51:35,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f765b3d2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3266dbc8}, log id: d757ed5 >2014-01-30 06:51:35,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: e42b586 >2014-01-30 06:51:35,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: e42b586 >2014-01-30 06:51:35,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7612fc03 >2014-01-30 06:51:35,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7612fc03 >2014-01-30 06:51:40,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5134a8b >2014-01-30 06:51:41,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5134a8b >2014-01-30 06:51:41,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2254466a >2014-01-30 06:51:41,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@166db6ab, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f8d7c0f}, log id: 2254466a >2014-01-30 06:51:41,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 28d97115 >2014-01-30 06:51:42,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 28d97115 >2014-01-30 06:51:42,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 81c05f9 >2014-01-30 06:51:42,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 81c05f9 >2014-01-30 06:51:47,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3771bf96 >2014-01-30 06:51:47,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3771bf96 >2014-01-30 06:51:47,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50bc61f3 >2014-01-30 06:51:48,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea5536c4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21fc8914}, log id: 50bc61f3 >2014-01-30 06:51:48,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 28085c6 >2014-01-30 06:51:48,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 28085c6 >2014-01-30 06:51:48,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: fcf3748 >2014-01-30 06:51:48,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fcf3748 >2014-01-30 06:51:53,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 28bb9511 >2014-01-30 06:51:54,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 28bb9511 >2014-01-30 06:51:54,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60605dcd >2014-01-30 06:51:54,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b7740c6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9914f56b}, log id: 60605dcd >2014-01-30 06:51:54,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 62edff49 >2014-01-30 06:51:55,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 62edff49 >2014-01-30 06:51:55,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4fcef48d >2014-01-30 06:51:55,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fcef48d >2014-01-30 06:52:00,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f2ca176 >2014-01-30 06:52:01,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7f2ca176 >2014-01-30 06:52:01,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 440178d4 >2014-01-30 06:52:01,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2344697e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@969adae3}, log id: 440178d4 >2014-01-30 06:52:01,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2d977a6c >2014-01-30 06:52:01,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2d977a6c >2014-01-30 06:52:01,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 440fd1fe >2014-01-30 06:52:02,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 440fd1fe >2014-01-30 06:52:07,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4837ddf5 >2014-01-30 06:52:07,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4837ddf5 >2014-01-30 06:52:07,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22202754 >2014-01-30 06:52:07,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@688f93a0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc2f4bc0}, log id: 22202754 >2014-01-30 06:52:07,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4b21ce5d >2014-01-30 06:52:08,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4b21ce5d >2014-01-30 06:52:08,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7315c1e2 >2014-01-30 06:52:08,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7315c1e2 >2014-01-30 06:52:13,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2fc748d8 >2014-01-30 06:52:14,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2fc748d8 >2014-01-30 06:52:14,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31ed18c1 >2014-01-30 06:52:14,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0c4d367, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@528fec11}, log id: 31ed18c1 >2014-01-30 06:52:14,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 502bceb0 >2014-01-30 06:52:15,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 502bceb0 >2014-01-30 06:52:15,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 50175fea >2014-01-30 06:52:15,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50175fea >2014-01-30 06:52:20,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65068b8e >2014-01-30 06:52:20,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 65068b8e >2014-01-30 06:52:20,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d059b8b >2014-01-30 06:52:21,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba076cc4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8c0a454}, log id: d059b8b >2014-01-30 06:52:21,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 43b2ad19 >2014-01-30 06:52:21,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 43b2ad19 >2014-01-30 06:52:21,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 407527cb >2014-01-30 06:52:21,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 407527cb >2014-01-30 06:52:26,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3cde373c >2014-01-30 06:52:27,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3cde373c >2014-01-30 06:52:27,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d54d50e >2014-01-30 06:52:27,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3b1637e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7b947af}, log id: 2d54d50e >2014-01-30 06:52:27,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 50d109f >2014-01-30 06:52:28,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 50d109f >2014-01-30 06:52:28,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4cc51a2f >2014-01-30 06:52:28,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4cc51a2f >2014-01-30 06:52:33,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c438cfb >2014-01-30 06:52:33,719 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2014-01-30 06:52:33,719 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:52:33,722 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2014-01-30 06:52:33,722 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:52:33,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 2c2f25f1 >2014-01-30 06:52:33,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7c438cfb >2014-01-30 06:52:33,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e9ed14a >2014-01-30 06:52:34,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7a59b0f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2897ffe9}, log id: 6e9ed14a >2014-01-30 06:52:34,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: e799f94 >2014-01-30 06:52:34,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 2c2f25f1 >2014-01-30 06:52:34,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 2e648133 >2014-01-30 06:52:34,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [], log id: 2e648133 >2014-01-30 06:52:34,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: e799f94 >2014-01-30 06:52:34,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 242034a1 >2014-01-30 06:52:34,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 242034a1 >2014-01-30 06:52:39,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 173e8deb >2014-01-30 06:52:40,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 173e8deb >2014-01-30 06:52:40,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1555dbaf >2014-01-30 06:52:40,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@627d89b5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38cdc7c1}, log id: 1555dbaf >2014-01-30 06:52:40,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5bbde1df >2014-01-30 06:52:41,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5bbde1df >2014-01-30 06:52:41,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 21a4eaa1 >2014-01-30 06:52:41,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21a4eaa1 >2014-01-30 06:52:46,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 55b3c13c >2014-01-30 06:52:46,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 55b3c13c >2014-01-30 06:52:46,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60e54182 >2014-01-30 06:52:47,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58c964e8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66510e97}, log id: 60e54182 >2014-01-30 06:52:47,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 79a976a6 >2014-01-30 06:52:47,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 79a976a6 >2014-01-30 06:52:47,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3b58621b >2014-01-30 06:52:47,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b58621b >2014-01-30 06:52:52,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4607d064 >2014-01-30 06:52:53,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4607d064 >2014-01-30 06:52:53,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b1ca592 >2014-01-30 06:52:53,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23146e66, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be6a2f8f}, log id: 4b1ca592 >2014-01-30 06:52:53,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3afec27d >2014-01-30 06:52:54,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3afec27d >2014-01-30 06:52:54,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 23e2e4ce >2014-01-30 06:52:54,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23e2e4ce >2014-01-30 06:52:59,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e9d6ef7 >2014-01-30 06:53:00,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7e9d6ef7 >2014-01-30 06:53:00,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26942b77 >2014-01-30 06:53:00,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@668126e0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f5aad2}, log id: 26942b77 >2014-01-30 06:53:00,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3c3dd1ac >2014-01-30 06:53:00,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3c3dd1ac >2014-01-30 06:53:00,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7fb31a95 >2014-01-30 06:53:01,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fb31a95 >2014-01-30 06:53:06,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3794acb >2014-01-30 06:53:06,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3794acb >2014-01-30 06:53:06,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41012b7b >2014-01-30 06:53:06,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7872e26e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6fba86}, log id: 41012b7b >2014-01-30 06:53:06,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 28cfc4e3 >2014-01-30 06:53:07,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 28cfc4e3 >2014-01-30 06:53:07,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3b4b79d3 >2014-01-30 06:53:07,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3b4b79d3 >2014-01-30 06:53:12,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 62c71691 >2014-01-30 06:53:13,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 62c71691 >2014-01-30 06:53:13,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5bb7a54b >2014-01-30 06:53:13,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d4a5f49, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ceaf31e1}, log id: 5bb7a54b >2014-01-30 06:53:13,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 449a72ee >2014-01-30 06:53:13,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 449a72ee >2014-01-30 06:53:13,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ed7c8a1 >2014-01-30 06:53:14,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ed7c8a1 >2014-01-30 06:53:19,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e455f73 >2014-01-30 06:53:19,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2e455f73 >2014-01-30 06:53:19,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d58acf1 >2014-01-30 06:53:19,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad9adee2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ddeb277}, log id: 5d58acf1 >2014-01-30 06:53:19,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 451d2dda >2014-01-30 06:53:20,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 451d2dda >2014-01-30 06:53:20,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3d978774 >2014-01-30 06:53:20,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d978774 >2014-01-30 06:53:25,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 377668f7 >2014-01-30 06:53:26,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 377668f7 >2014-01-30 06:53:26,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1954d585 >2014-01-30 06:53:26,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cba85ffe, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3385e77d}, log id: 1954d585 >2014-01-30 06:53:26,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7c821376 >2014-01-30 06:53:27,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7c821376 >2014-01-30 06:53:27,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 234bb39e >2014-01-30 06:53:27,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 234bb39e >2014-01-30 06:53:32,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7cb33ec2 >2014-01-30 06:53:32,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7cb33ec2 >2014-01-30 06:53:32,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d3e9fe7 >2014-01-30 06:53:33,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ef244e6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7948a0c}, log id: 1d3e9fe7 >2014-01-30 06:53:33,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1f6dfea3 >2014-01-30 06:53:33,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1f6dfea3 >2014-01-30 06:53:33,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 563a87c >2014-01-30 06:53:33,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 563a87c >2014-01-30 06:53:34,500 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-30) [88aff39] No up server in cluster >2014-01-30 06:53:34,500 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-30) [88aff39] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:53:34,503 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-30) [88aff39] No up server in cluster >2014-01-30 06:53:34,503 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-30) [88aff39] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:53:34,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 307431a9 >2014-01-30 06:53:35,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 307431a9 >2014-01-30 06:53:35,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 12b41ffb >2014-01-30 06:53:35,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterTasksListVDSCommand, return: [], log id: 12b41ffb >2014-01-30 06:53:38,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33bf42c7 >2014-01-30 06:53:39,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 33bf42c7 >2014-01-30 06:53:39,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49c5016e >2014-01-30 06:53:39,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6b06d1e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54d9d76e}, log id: 49c5016e >2014-01-30 06:53:39,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 677a0979 >2014-01-30 06:53:40,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 677a0979 >2014-01-30 06:53:40,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 478437f2 >2014-01-30 06:53:40,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 478437f2 >2014-01-30 06:53:45,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 302253d4 >2014-01-30 06:53:45,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 302253d4 >2014-01-30 06:53:45,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32d429c1 >2014-01-30 06:53:46,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33011253, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74854fa0}, log id: 32d429c1 >2014-01-30 06:53:46,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 26998a83 >2014-01-30 06:53:46,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 26998a83 >2014-01-30 06:53:46,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5ba0db79 >2014-01-30 06:53:47,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ba0db79 >2014-01-30 06:53:52,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b288725 >2014-01-30 06:53:52,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3b288725 >2014-01-30 06:53:52,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2db20af9 >2014-01-30 06:53:52,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3274dad, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4a02bfc}, log id: 2db20af9 >2014-01-30 06:53:52,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1a771195 >2014-01-30 06:53:53,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1a771195 >2014-01-30 06:53:53,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7147399b >2014-01-30 06:53:53,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7147399b >2014-01-30 06:53:58,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ff3beff >2014-01-30 06:53:59,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2ff3beff >2014-01-30 06:53:59,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 733c38c7 >2014-01-30 06:53:59,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9a73f7c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@501567f}, log id: 733c38c7 >2014-01-30 06:53:59,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 15adde7 >2014-01-30 06:53:59,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 15adde7 >2014-01-30 06:53:59,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6cbb1d3d >2014-01-30 06:54:00,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6cbb1d3d >2014-01-30 06:54:05,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3910f915 >2014-01-30 06:54:05,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3910f915 >2014-01-30 06:54:05,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 135615 >2014-01-30 06:54:05,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b990d4b8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6e59b1b}, log id: 135615 >2014-01-30 06:54:05,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 13aa0d28 >2014-01-30 06:54:06,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 13aa0d28 >2014-01-30 06:54:06,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7b823eec >2014-01-30 06:54:06,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b823eec >2014-01-30 06:54:11,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6623784b >2014-01-30 06:54:12,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6623784b >2014-01-30 06:54:12,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 196ae6ec >2014-01-30 06:54:12,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5f279b0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46df0d45}, log id: 196ae6ec >2014-01-30 06:54:12,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: c564b04 >2014-01-30 06:54:13,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: c564b04 >2014-01-30 06:54:13,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 538a8ec >2014-01-30 06:54:13,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 538a8ec >2014-01-30 06:54:18,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2181d0f9 >2014-01-30 06:54:18,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2181d0f9 >2014-01-30 06:54:18,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66b08ba4 >2014-01-30 06:54:19,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d00e8f15, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dda0625f}, log id: 66b08ba4 >2014-01-30 06:54:19,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 69d752ee >2014-01-30 06:54:19,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 69d752ee >2014-01-30 06:54:19,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77d2e467 >2014-01-30 06:54:19,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77d2e467 >2014-01-30 06:54:24,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25cf97a9 >2014-01-30 06:54:25,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 25cf97a9 >2014-01-30 06:54:25,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a7884bc >2014-01-30 06:54:25,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@647195bd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da433b03}, log id: 1a7884bc >2014-01-30 06:54:25,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2112d547 >2014-01-30 06:54:26,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2112d547 >2014-01-30 06:54:26,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 39a14a44 >2014-01-30 06:54:26,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39a14a44 >2014-01-30 06:54:31,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 115cb1f5 >2014-01-30 06:54:31,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 115cb1f5 >2014-01-30 06:54:31,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31dc62e8 >2014-01-30 06:54:32,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c83a47b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7bb7af}, log id: 31dc62e8 >2014-01-30 06:54:32,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7fbcc7d3 >2014-01-30 06:54:32,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7fbcc7d3 >2014-01-30 06:54:32,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 44c45900 >2014-01-30 06:54:32,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44c45900 >2014-01-30 06:54:35,301 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-65) [227486be] No up server in cluster >2014-01-30 06:54:35,302 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-65) [227486be] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:54:35,305 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-65) [227486be] No up server in cluster >2014-01-30 06:54:35,305 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-65) [227486be] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:54:35,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 54f7db4 >2014-01-30 06:54:35,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 54f7db4 >2014-01-30 06:54:35,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 783582c0 >2014-01-30 06:54:36,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterTasksListVDSCommand, return: [], log id: 783582c0 >2014-01-30 06:54:37,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 231d9bfb >2014-01-30 06:54:38,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 231d9bfb >2014-01-30 06:54:38,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4551fbd8 >2014-01-30 06:54:38,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a8d0705, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be25aeb3}, log id: 4551fbd8 >2014-01-30 06:54:38,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4a059e >2014-01-30 06:54:39,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4a059e >2014-01-30 06:54:39,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 63588bd >2014-01-30 06:54:39,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63588bd >2014-01-30 06:54:44,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2dccb812 >2014-01-30 06:54:44,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2dccb812 >2014-01-30 06:54:44,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a36a16d >2014-01-30 06:54:45,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7df7401f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d9fc901}, log id: 1a36a16d >2014-01-30 06:54:45,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 52895472 >2014-01-30 06:54:45,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 52895472 >2014-01-30 06:54:45,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2beae915 >2014-01-30 06:54:46,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2beae915 >2014-01-30 06:54:51,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b0f1b8e >2014-01-30 06:54:51,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7b0f1b8e >2014-01-30 06:54:51,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7bae4f25 >2014-01-30 06:54:51,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49f612a2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbcffb40}, log id: 7bae4f25 >2014-01-30 06:54:51,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 13a1eec1 >2014-01-30 06:54:52,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 13a1eec1 >2014-01-30 06:54:52,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 55c583c3 >2014-01-30 06:54:52,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55c583c3 >2014-01-30 06:54:57,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f3b268 >2014-01-30 06:54:58,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f3b268 >2014-01-30 06:54:58,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c887f3c >2014-01-30 06:54:58,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64438cc5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35bd7fd6}, log id: c887f3c >2014-01-30 06:54:58,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1af613b9 >2014-01-30 06:54:58,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1af613b9 >2014-01-30 06:54:58,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 112aee75 >2014-01-30 06:54:59,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 112aee75 >2014-01-30 06:55:04,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b802b74 >2014-01-30 06:55:04,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1b802b74 >2014-01-30 06:55:04,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 884f894 >2014-01-30 06:55:04,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bd1dca4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@747d100c}, log id: 884f894 >2014-01-30 06:55:04,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4bcb0311 >2014-01-30 06:55:05,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4bcb0311 >2014-01-30 06:55:05,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7e53b818 >2014-01-30 06:55:05,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e53b818 >2014-01-30 06:55:09,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 5db37490 >2014-01-30 06:55:09,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3058db94, log id: 5db37490 >2014-01-30 06:55:09,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 19b7ea58 >2014-01-30 06:55:09,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3fd18733, log id: 19b7ea58 >2014-01-30 06:55:10,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21e34878 >2014-01-30 06:55:11,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 21e34878 >2014-01-30 06:55:11,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 107df00d >2014-01-30 06:55:11,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62b76589, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff004d45}, log id: 107df00d >2014-01-30 06:55:11,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 42c26ca9 >2014-01-30 06:55:12,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 42c26ca9 >2014-01-30 06:55:12,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 58d5db57 >2014-01-30 06:55:12,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58d5db57 >2014-01-30 06:55:17,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6788330 >2014-01-30 06:55:17,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6788330 >2014-01-30 06:55:17,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58824c68 >2014-01-30 06:55:18,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25ec4d76, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7e930fd}, log id: 58824c68 >2014-01-30 06:55:18,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7bcac5d4 >2014-01-30 06:55:18,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7bcac5d4 >2014-01-30 06:55:18,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 61480ff8 >2014-01-30 06:55:18,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61480ff8 >2014-01-30 06:55:23,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e7e9de1 >2014-01-30 06:55:24,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1e7e9de1 >2014-01-30 06:55:24,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3aa91305 >2014-01-30 06:55:24,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c5bf3eb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3216983}, log id: 3aa91305 >2014-01-30 06:55:24,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 39517c1f >2014-01-30 06:55:25,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 39517c1f >2014-01-30 06:55:25,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 293d8a44 >2014-01-30 06:55:25,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 293d8a44 >2014-01-30 06:55:30,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 618e0b3f >2014-01-30 06:55:30,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 618e0b3f >2014-01-30 06:55:30,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44ef68fb >2014-01-30 06:55:31,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0b6fab3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2ad723d}, log id: 44ef68fb >2014-01-30 06:55:31,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5bcb88f8 >2014-01-30 06:55:31,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5bcb88f8 >2014-01-30 06:55:31,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 47243916 >2014-01-30 06:55:31,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47243916 >2014-01-30 06:55:36,119 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] No up server in cluster >2014-01-30 06:55:36,119 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:55:36,123 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] No up server in cluster >2014-01-30 06:55:36,123 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:55:36,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 92e3c34 >2014-01-30 06:55:36,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 92e3c34 >2014-01-30 06:55:36,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3bca2b3a >2014-01-30 06:55:36,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterTasksListVDSCommand, return: [], log id: 3bca2b3a >2014-01-30 06:55:36,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 190d102b >2014-01-30 06:55:37,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 190d102b >2014-01-30 06:55:37,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 714a8784 >2014-01-30 06:55:37,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31bdf827, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f68b213}, log id: 714a8784 >2014-01-30 06:55:37,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: fe0288b >2014-01-30 06:55:38,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: fe0288b >2014-01-30 06:55:38,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7178cd2 >2014-01-30 06:55:38,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7178cd2 >2014-01-30 06:55:43,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ea934f4 >2014-01-30 06:55:44,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2ea934f4 >2014-01-30 06:55:44,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77ae34eb >2014-01-30 06:55:44,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76b81ef3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d70f7b3}, log id: 77ae34eb >2014-01-30 06:55:44,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 78c9b64a >2014-01-30 06:55:44,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 78c9b64a >2014-01-30 06:55:44,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 48816185 >2014-01-30 06:55:45,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48816185 >2014-01-30 06:55:50,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15629702 >2014-01-30 06:55:50,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 15629702 >2014-01-30 06:55:50,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36e55eb1 >2014-01-30 06:55:50,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d714581, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c9ebce8}, log id: 36e55eb1 >2014-01-30 06:55:50,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2a0bbb18 >2014-01-30 06:55:51,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2a0bbb18 >2014-01-30 06:55:51,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c3a4aad >2014-01-30 06:55:51,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c3a4aad >2014-01-30 06:55:56,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26651ba2 >2014-01-30 06:55:57,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 26651ba2 >2014-01-30 06:55:57,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a0af2e7 >2014-01-30 06:55:57,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82b39c7c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cab1a604}, log id: 7a0af2e7 >2014-01-30 06:55:57,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 64315b42 >2014-01-30 06:55:57,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 64315b42 >2014-01-30 06:55:57,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 369b389f >2014-01-30 06:55:58,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 369b389f >2014-01-30 06:56:03,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6653d0a0 >2014-01-30 06:56:03,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6653d0a0 >2014-01-30 06:56:03,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17887dc9 >2014-01-30 06:56:04,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e55b1784, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e20999ed}, log id: 17887dc9 >2014-01-30 06:56:04,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4d69417b >2014-01-30 06:56:04,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4d69417b >2014-01-30 06:56:04,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4090e5be >2014-01-30 06:56:04,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4090e5be >2014-01-30 06:56:09,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 184780fa >2014-01-30 06:56:10,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 184780fa >2014-01-30 06:56:10,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5119d7ad >2014-01-30 06:56:10,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d858bb7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3538165a}, log id: 5119d7ad >2014-01-30 06:56:10,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2af5c219 >2014-01-30 06:56:11,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2af5c219 >2014-01-30 06:56:11,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4797d53c >2014-01-30 06:56:11,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4797d53c >2014-01-30 06:56:16,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c20d963 >2014-01-30 06:56:16,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7c20d963 >2014-01-30 06:56:16,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ad7c376 >2014-01-30 06:56:17,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bc2f4f5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8a68c22}, log id: 3ad7c376 >2014-01-30 06:56:17,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6f099de2 >2014-01-30 06:56:17,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6f099de2 >2014-01-30 06:56:17,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 20ffbf76 >2014-01-30 06:56:17,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20ffbf76 >2014-01-30 06:56:22,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ee34b9f >2014-01-30 06:56:23,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3ee34b9f >2014-01-30 06:56:23,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 594607ac >2014-01-30 06:56:23,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@838baa78, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bc680f7}, log id: 594607ac >2014-01-30 06:56:23,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 79171b1 >2014-01-30 06:56:24,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 79171b1 >2014-01-30 06:56:24,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ac22d57 >2014-01-30 06:56:24,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ac22d57 >2014-01-30 06:56:29,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4cb3c8b1 >2014-01-30 06:56:29,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4cb3c8b1 >2014-01-30 06:56:29,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66ec6bd8 >2014-01-30 06:56:30,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d2a35f9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@585888b7}, log id: 66ec6bd8 >2014-01-30 06:56:30,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1bd0298f >2014-01-30 06:56:30,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1bd0298f >2014-01-30 06:56:30,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 50dde64a >2014-01-30 06:56:30,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50dde64a >2014-01-30 06:56:35,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c33595 >2014-01-30 06:56:36,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4c33595 >2014-01-30 06:56:36,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69ac63c >2014-01-30 06:56:36,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e15d5e9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25850711}, log id: 69ac63c >2014-01-30 06:56:36,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 51dc5aeb >2014-01-30 06:56:36,936 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] No up server in cluster >2014-01-30 06:56:36,936 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:56:36,939 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] No up server in cluster >2014-01-30 06:56:36,939 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:56:36,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 4919b405 >2014-01-30 06:56:37,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 51dc5aeb >2014-01-30 06:56:37,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e12ca41 >2014-01-30 06:56:37,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4919b405 >2014-01-30 06:56:37,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: c4485bf >2014-01-30 06:56:37,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e12ca41 >2014-01-30 06:56:37,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterTasksListVDSCommand, return: [], log id: c4485bf >2014-01-30 06:56:42,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f46ba75 >2014-01-30 06:56:43,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5f46ba75 >2014-01-30 06:56:43,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2dd99067 >2014-01-30 06:56:43,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb1208c1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6459d91f}, log id: 2dd99067 >2014-01-30 06:56:43,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2e4f9e0f >2014-01-30 06:56:43,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2e4f9e0f >2014-01-30 06:56:43,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7ad5918c >2014-01-30 06:56:44,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ad5918c >2014-01-30 06:56:49,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7264eac7 >2014-01-30 06:56:49,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7264eac7 >2014-01-30 06:56:49,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f3bf86c >2014-01-30 06:56:49,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f3995ee, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b17e438}, log id: 6f3bf86c >2014-01-30 06:56:49,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6bc745f1 >2014-01-30 06:56:50,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6bc745f1 >2014-01-30 06:56:50,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4459b45a >2014-01-30 06:56:50,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4459b45a >2014-01-30 06:56:55,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ed571d3 >2014-01-30 06:56:56,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7ed571d3 >2014-01-30 06:56:56,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4408dc72 >2014-01-30 06:56:56,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bebddbc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6dc6d1d}, log id: 4408dc72 >2014-01-30 06:56:56,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4421927f >2014-01-30 06:56:56,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4421927f >2014-01-30 06:56:56,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 266d8fb3 >2014-01-30 06:56:57,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 266d8fb3 >2014-01-30 06:57:02,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e79d752 >2014-01-30 06:57:02,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7e79d752 >2014-01-30 06:57:02,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c136ff3 >2014-01-30 06:57:02,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78847cf5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a7c6f79}, log id: 6c136ff3 >2014-01-30 06:57:03,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 25b6e8c3 >2014-01-30 06:57:03,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 25b6e8c3 >2014-01-30 06:57:03,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77b609f4 >2014-01-30 06:57:03,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77b609f4 >2014-01-30 06:57:08,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74054a07 >2014-01-30 06:57:09,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 74054a07 >2014-01-30 06:57:09,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e4dd292 >2014-01-30 06:57:09,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52393cb9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50cede4c}, log id: 2e4dd292 >2014-01-30 06:57:09,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5f3c47ad >2014-01-30 06:57:10,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5f3c47ad >2014-01-30 06:57:10,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4518561b >2014-01-30 06:57:10,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4518561b >2014-01-30 06:57:15,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a409d54 >2014-01-30 06:57:15,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1a409d54 >2014-01-30 06:57:15,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2fe49778 >2014-01-30 06:57:16,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@afacb8c0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5bdcdc3a}, log id: 2fe49778 >2014-01-30 06:57:16,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4adbfa3a >2014-01-30 06:57:16,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4adbfa3a >2014-01-30 06:57:16,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 641e6219 >2014-01-30 06:57:16,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 641e6219 >2014-01-30 06:57:21,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a3dee27 >2014-01-30 06:57:22,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2a3dee27 >2014-01-30 06:57:22,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e3618a5 >2014-01-30 06:57:22,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86f4ee00, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f3f2edd}, log id: e3618a5 >2014-01-30 06:57:22,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4bd96ae3 >2014-01-30 06:57:23,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4bd96ae3 >2014-01-30 06:57:23,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 33ee72b4 >2014-01-30 06:57:23,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33ee72b4 >2014-01-30 06:57:28,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d0a3935 >2014-01-30 06:57:28,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4d0a3935 >2014-01-30 06:57:28,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67601e49 >2014-01-30 06:57:29,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5df54200, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e977073c}, log id: 67601e49 >2014-01-30 06:57:29,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7552ad5 >2014-01-30 06:57:29,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7552ad5 >2014-01-30 06:57:29,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 397c941 >2014-01-30 06:57:29,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 397c941 >2014-01-30 06:57:34,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12d59d6d >2014-01-30 06:57:35,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 12d59d6d >2014-01-30 06:57:35,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b59b27 >2014-01-30 06:57:35,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4bd320c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c017a7b}, log id: 7b59b27 >2014-01-30 06:57:35,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5f1469a9 >2014-01-30 06:57:36,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5f1469a9 >2014-01-30 06:57:36,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4b0ebbee >2014-01-30 06:57:36,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b0ebbee >2014-01-30 06:57:37,718 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-87) [6fd19374] No up server in cluster >2014-01-30 06:57:37,718 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-87) [6fd19374] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:57:37,721 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-87) [6fd19374] No up server in cluster >2014-01-30 06:57:37,722 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-87) [6fd19374] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:57:37,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 247237e8 >2014-01-30 06:57:38,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 247237e8 >2014-01-30 06:57:38,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 71b1a79b >2014-01-30 06:57:38,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterTasksListVDSCommand, return: [], log id: 71b1a79b >2014-01-30 06:57:41,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c0c806 >2014-01-30 06:57:42,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3c0c806 >2014-01-30 06:57:42,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35972fe9 >2014-01-30 06:57:42,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8fa65a6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dff926fe}, log id: 35972fe9 >2014-01-30 06:57:42,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 31ada465 >2014-01-30 06:57:42,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 31ada465 >2014-01-30 06:57:42,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6e3db6da >2014-01-30 06:57:43,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e3db6da >2014-01-30 06:57:48,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 631f78a7 >2014-01-30 06:57:48,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 631f78a7 >2014-01-30 06:57:48,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c0fd4b2 >2014-01-30 06:57:48,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18a9448f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a281cbd6}, log id: 6c0fd4b2 >2014-01-30 06:57:48,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3a249ccf >2014-01-30 06:57:49,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3a249ccf >2014-01-30 06:57:49,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 736af0e8 >2014-01-30 06:57:49,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 736af0e8 >2014-01-30 06:57:54,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 772f2d56 >2014-01-30 06:57:55,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 772f2d56 >2014-01-30 06:57:55,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fd2d39c >2014-01-30 06:57:55,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55812fe5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a8ed076}, log id: 3fd2d39c >2014-01-30 06:57:55,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 29eb9ab >2014-01-30 06:57:55,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 29eb9ab >2014-01-30 06:57:55,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2ed1496a >2014-01-30 06:57:56,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ed1496a >2014-01-30 06:58:01,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6fcbf5c6 >2014-01-30 06:58:02,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6fcbf5c6 >2014-01-30 06:58:02,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 607ad73a >2014-01-30 06:58:02,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8782041d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b591f157}, log id: 607ad73a >2014-01-30 06:58:02,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2e27e564 >2014-01-30 06:58:02,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2e27e564 >2014-01-30 06:58:02,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 51ba94f1 >2014-01-30 06:58:03,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51ba94f1 >2014-01-30 06:58:08,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25137de0 >2014-01-30 06:58:08,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 25137de0 >2014-01-30 06:58:08,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7483e493 >2014-01-30 06:58:08,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd698b1b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@712ecedd}, log id: 7483e493 >2014-01-30 06:58:08,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7bdf4375 >2014-01-30 06:58:09,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7bdf4375 >2014-01-30 06:58:09,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 725c8b58 >2014-01-30 06:58:09,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 725c8b58 >2014-01-30 06:58:14,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e48c8b5 >2014-01-30 06:58:15,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2e48c8b5 >2014-01-30 06:58:15,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 107f01f3 >2014-01-30 06:58:15,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f400a3c7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce664de7}, log id: 107f01f3 >2014-01-30 06:58:15,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 901323 >2014-01-30 06:58:15,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 901323 >2014-01-30 06:58:15,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65520310 >2014-01-30 06:58:16,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65520310 >2014-01-30 06:58:21,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3da1931c >2014-01-30 06:58:21,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3da1931c >2014-01-30 06:58:21,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 107c3328 >2014-01-30 06:58:21,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28246e1c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1f2b3a4}, log id: 107c3328 >2014-01-30 06:58:22,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 473e6cbd >2014-01-30 06:58:22,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 473e6cbd >2014-01-30 06:58:22,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 57a54116 >2014-01-30 06:58:22,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57a54116 >2014-01-30 06:58:27,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 751c6a90 >2014-01-30 06:58:28,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 751c6a90 >2014-01-30 06:58:28,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ff2e7d6 >2014-01-30 06:58:28,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce69a9f0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a05233d8}, log id: 2ff2e7d6 >2014-01-30 06:58:28,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 342df8d5 >2014-01-30 06:58:29,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 342df8d5 >2014-01-30 06:58:29,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 13fbfa5c >2014-01-30 06:58:29,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13fbfa5c >2014-01-30 06:58:34,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 735c8ef4 >2014-01-30 06:58:34,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 735c8ef4 >2014-01-30 06:58:34,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1cff8fb6 >2014-01-30 06:58:35,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e593c37f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71dc20d1}, log id: 1cff8fb6 >2014-01-30 06:58:35,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 449332c4 >2014-01-30 06:58:35,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 449332c4 >2014-01-30 06:58:35,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d3e2195 >2014-01-30 06:58:35,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d3e2195 >2014-01-30 06:58:38,550 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] No up server in cluster >2014-01-30 06:58:38,551 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:58:38,554 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] No up server in cluster >2014-01-30 06:58:38,554 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:58:38,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 192698a0 >2014-01-30 06:58:39,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 192698a0 >2014-01-30 06:58:39,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 2cb6d69e >2014-01-30 06:58:39,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterTasksListVDSCommand, return: [], log id: 2cb6d69e >2014-01-30 06:58:40,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29b51e3e >2014-01-30 06:58:41,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 29b51e3e >2014-01-30 06:58:41,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 662af501 >2014-01-30 06:58:41,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3acb2677, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3338a3f}, log id: 662af501 >2014-01-30 06:58:41,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ea282d2 >2014-01-30 06:58:42,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3ea282d2 >2014-01-30 06:58:42,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c686e54 >2014-01-30 06:58:42,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c686e54 >2014-01-30 06:58:47,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14eeb577 >2014-01-30 06:58:48,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 14eeb577 >2014-01-30 06:58:48,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7af1539d >2014-01-30 06:58:48,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@add755df, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a27b8fda}, log id: 7af1539d >2014-01-30 06:58:48,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d079abd >2014-01-30 06:58:48,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: d079abd >2014-01-30 06:58:48,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 18725749 >2014-01-30 06:58:49,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18725749 >2014-01-30 06:58:54,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 412cc952 >2014-01-30 06:58:54,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 412cc952 >2014-01-30 06:58:54,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 710f56d2 >2014-01-30 06:58:54,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c954526, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef28944}, log id: 710f56d2 >2014-01-30 06:58:54,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 66fa450a >2014-01-30 06:58:55,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 66fa450a >2014-01-30 06:58:55,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 56e3ff03 >2014-01-30 06:58:55,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 56e3ff03 >2014-01-30 06:59:00,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 506c36b7 >2014-01-30 06:59:01,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 506c36b7 >2014-01-30 06:59:01,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77d402c6 >2014-01-30 06:59:01,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aed2cb48, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@612f33f9}, log id: 77d402c6 >2014-01-30 06:59:01,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 59731250 >2014-01-30 06:59:01,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 59731250 >2014-01-30 06:59:01,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 72c15b87 >2014-01-30 06:59:02,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72c15b87 >2014-01-30 06:59:07,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 180c735e >2014-01-30 06:59:07,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 180c735e >2014-01-30 06:59:07,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78fcb855 >2014-01-30 06:59:08,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@464cd56a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a025095}, log id: 78fcb855 >2014-01-30 06:59:08,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 171849be >2014-01-30 06:59:08,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 171849be >2014-01-30 06:59:08,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7b95ccf5 >2014-01-30 06:59:08,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b95ccf5 >2014-01-30 06:59:13,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4145c435 >2014-01-30 06:59:14,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4145c435 >2014-01-30 06:59:14,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e460c6c >2014-01-30 06:59:14,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e48836df, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7492143f}, log id: 5e460c6c >2014-01-30 06:59:14,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3718b315 >2014-01-30 06:59:15,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3718b315 >2014-01-30 06:59:15,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ae2dbbb >2014-01-30 06:59:15,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ae2dbbb >2014-01-30 06:59:20,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7fd63d8f >2014-01-30 06:59:20,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7fd63d8f >2014-01-30 06:59:20,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77dee435 >2014-01-30 06:59:21,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5dc9e1a2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84766708}, log id: 77dee435 >2014-01-30 06:59:21,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 556dd8df >2014-01-30 06:59:21,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 556dd8df >2014-01-30 06:59:21,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 57525dbd >2014-01-30 06:59:21,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57525dbd >2014-01-30 06:59:26,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 567a71bb >2014-01-30 06:59:27,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 567a71bb >2014-01-30 06:59:27,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2953af2 >2014-01-30 06:59:27,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3edeaf02, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1d8e6ca}, log id: 2953af2 >2014-01-30 06:59:27,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 709e6a92 >2014-01-30 06:59:28,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 709e6a92 >2014-01-30 06:59:28,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7061e462 >2014-01-30 06:59:28,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7061e462 >2014-01-30 06:59:33,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4043c28b >2014-01-30 06:59:33,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4043c28b >2014-01-30 06:59:33,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2865c926 >2014-01-30 06:59:34,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc4db20b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e477ec1e}, log id: 2865c926 >2014-01-30 06:59:34,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 62169940 >2014-01-30 06:59:34,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 62169940 >2014-01-30 06:59:34,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5f785b97 >2014-01-30 06:59:34,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f785b97 >2014-01-30 06:59:39,385 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-36) [359e3b48] No up server in cluster >2014-01-30 06:59:39,385 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-36) [359e3b48] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:59:39,388 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-36) [359e3b48] No up server in cluster >2014-01-30 06:59:39,388 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-36) [359e3b48] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 06:59:39,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f1a6b4 >2014-01-30 06:59:39,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 1f1a6b4 >2014-01-30 06:59:39,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 568c5ad8 >2014-01-30 06:59:39,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1be16391 >2014-01-30 06:59:40,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterTasksListVDSCommand, return: [], log id: 568c5ad8 >2014-01-30 06:59:40,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1be16391 >2014-01-30 06:59:40,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 772b3ff >2014-01-30 06:59:40,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dca569c6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ecee4a3}, log id: 772b3ff >2014-01-30 06:59:40,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5f63a207 >2014-01-30 06:59:41,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5f63a207 >2014-01-30 06:59:41,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3daff838 >2014-01-30 06:59:41,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3daff838 >2014-01-30 06:59:46,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 478ab554 >2014-01-30 06:59:46,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 478ab554 >2014-01-30 06:59:46,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 767f71e2 >2014-01-30 06:59:47,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b097cd1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef9f25ec}, log id: 767f71e2 >2014-01-30 06:59:47,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2e07e722 >2014-01-30 06:59:47,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2e07e722 >2014-01-30 06:59:47,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a0bab55 >2014-01-30 06:59:48,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a0bab55 >2014-01-30 06:59:53,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3df3f67 >2014-01-30 06:59:53,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3df3f67 >2014-01-30 06:59:53,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31d101ac >2014-01-30 06:59:53,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a778c8b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2c9240}, log id: 31d101ac >2014-01-30 06:59:53,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 407cf183 >2014-01-30 06:59:54,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 407cf183 >2014-01-30 06:59:54,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3dffdc09 >2014-01-30 06:59:54,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3dffdc09 >2014-01-30 06:59:59,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66bc951b >2014-01-30 07:00:00,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 66bc951b >2014-01-30 07:00:00,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1397f583 >2014-01-30 07:00:00,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88288a8f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a861f54}, log id: 1397f583 >2014-01-30 07:00:00,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5d68e41e >2014-01-30 07:00:00,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5d68e41e >2014-01-30 07:00:00,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 28a44aa2 >2014-01-30 07:00:01,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28a44aa2 >2014-01-30 07:00:06,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24b5d36d >2014-01-30 07:00:06,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 24b5d36d >2014-01-30 07:00:06,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c2190ae >2014-01-30 07:00:06,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e205f754, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8c6c2d2}, log id: 2c2190ae >2014-01-30 07:00:07,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b99ad49 >2014-01-30 07:00:07,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2b99ad49 >2014-01-30 07:00:07,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 17c44af >2014-01-30 07:00:07,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17c44af >2014-01-30 07:00:09,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 3b27f633 >2014-01-30 07:00:10,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@583c4c9e, log id: 3b27f633 >2014-01-30 07:00:10,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 5eca4653 >2014-01-30 07:00:10,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@5700dd17, log id: 5eca4653 >2014-01-30 07:00:12,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76dd4cfb >2014-01-30 07:00:13,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 76dd4cfb >2014-01-30 07:00:13,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5aa697d9 >2014-01-30 07:00:13,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14b194a6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@347965a7}, log id: 5aa697d9 >2014-01-30 07:00:13,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 298b8b13 >2014-01-30 07:00:14,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 298b8b13 >2014-01-30 07:00:14,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3d7cff80 >2014-01-30 07:00:14,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d7cff80 >2014-01-30 07:00:19,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b028c06 >2014-01-30 07:00:19,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b028c06 >2014-01-30 07:00:19,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b689e02 >2014-01-30 07:00:20,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d645cec7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b22a238a}, log id: 2b689e02 >2014-01-30 07:00:20,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4bdd0add >2014-01-30 07:00:20,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4bdd0add >2014-01-30 07:00:20,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3d246e55 >2014-01-30 07:00:20,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d246e55 >2014-01-30 07:00:25,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50335dbb >2014-01-30 07:00:26,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 50335dbb >2014-01-30 07:00:26,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d862417 >2014-01-30 07:00:26,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94bbae3a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e259af0}, log id: 1d862417 >2014-01-30 07:00:26,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7fbe749e >2014-01-30 07:00:27,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7fbe749e >2014-01-30 07:00:27,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 617094d6 >2014-01-30 07:00:27,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 617094d6 >2014-01-30 07:00:32,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7355500d >2014-01-30 07:00:32,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7355500d >2014-01-30 07:00:32,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d26f2bd >2014-01-30 07:00:33,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10b11be, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b4afd1}, log id: d26f2bd >2014-01-30 07:00:33,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2fa8c4d0 >2014-01-30 07:00:33,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2fa8c4d0 >2014-01-30 07:00:33,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5bbc0227 >2014-01-30 07:00:33,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5bbc0227 >2014-01-30 07:00:38,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6404efd4 >2014-01-30 07:00:39,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6404efd4 >2014-01-30 07:00:39,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3752882e >2014-01-30 07:00:39,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ec3940b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3817cf0c}, log id: 3752882e >2014-01-30 07:00:39,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 31c1307c >2014-01-30 07:00:40,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 31c1307c >2014-01-30 07:00:40,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5dcee191 >2014-01-30 07:00:40,216 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2014-01-30 07:00:40,216 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:00:40,219 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2014-01-30 07:00:40,219 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:00:40,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 3ca46621 >2014-01-30 07:00:40,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5dcee191 >2014-01-30 07:00:40,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 3ca46621 >2014-01-30 07:00:40,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4a752303 >2014-01-30 07:00:41,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterTasksListVDSCommand, return: [], log id: 4a752303 >2014-01-30 07:00:45,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 721af36d >2014-01-30 07:00:45,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 721af36d >2014-01-30 07:00:45,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f4ddb57 >2014-01-30 07:00:46,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44171d64, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b46f16be}, log id: 6f4ddb57 >2014-01-30 07:00:46,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 55aefd91 >2014-01-30 07:00:46,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 55aefd91 >2014-01-30 07:00:46,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5d6ec11b >2014-01-30 07:00:47,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d6ec11b >2014-01-30 07:00:52,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21b37564 >2014-01-30 07:00:52,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 21b37564 >2014-01-30 07:00:52,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c66ef8 >2014-01-30 07:00:52,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9326db7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16950fe1}, log id: c66ef8 >2014-01-30 07:00:52,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d73fa9d >2014-01-30 07:00:53,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7d73fa9d >2014-01-30 07:00:53,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 71958f6b >2014-01-30 07:00:53,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71958f6b >2014-01-30 07:00:58,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46189ca >2014-01-30 07:00:59,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 46189ca >2014-01-30 07:00:59,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 433ae4dc >2014-01-30 07:00:59,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89caf889, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bd5e8af}, log id: 433ae4dc >2014-01-30 07:00:59,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 20a0c775 >2014-01-30 07:00:59,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 20a0c775 >2014-01-30 07:00:59,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1bed1ab8 >2014-01-30 07:01:00,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1bed1ab8 >2014-01-30 07:01:05,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f22a540 >2014-01-30 07:01:05,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: f22a540 >2014-01-30 07:01:05,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a572f41 >2014-01-30 07:01:05,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e1fe219, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@427ca1ea}, log id: 4a572f41 >2014-01-30 07:01:05,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5f3769f8 >2014-01-30 07:01:06,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5f3769f8 >2014-01-30 07:01:06,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 78d2e28d >2014-01-30 07:01:06,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78d2e28d >2014-01-30 07:01:11,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a06034a >2014-01-30 07:01:12,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6a06034a >2014-01-30 07:01:12,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 151b0f0 >2014-01-30 07:01:12,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b6eaf8f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@695ce074}, log id: 151b0f0 >2014-01-30 07:01:12,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 21f9be92 >2014-01-30 07:01:13,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 21f9be92 >2014-01-30 07:01:13,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2522d7c >2014-01-30 07:01:13,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2522d7c >2014-01-30 07:01:18,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 509744e1 >2014-01-30 07:01:18,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 509744e1 >2014-01-30 07:01:18,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f9dd487 >2014-01-30 07:01:19,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d62c1ae2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@104b867b}, log id: f9dd487 >2014-01-30 07:01:19,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 204fa1f3 >2014-01-30 07:01:19,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 204fa1f3 >2014-01-30 07:01:19,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 495af1c4 >2014-01-30 07:01:19,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 495af1c4 >2014-01-30 07:01:24,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ee2a985 >2014-01-30 07:01:25,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3ee2a985 >2014-01-30 07:01:25,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64c1108a >2014-01-30 07:01:25,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc57b9a0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9047260c}, log id: 64c1108a >2014-01-30 07:01:25,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 38a06e79 >2014-01-30 07:01:26,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 38a06e79 >2014-01-30 07:01:26,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 620b9036 >2014-01-30 07:01:26,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 620b9036 >2014-01-30 07:01:31,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ff72e0b >2014-01-30 07:01:31,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1ff72e0b >2014-01-30 07:01:31,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67000cb7 >2014-01-30 07:01:32,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@757548d9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@274d0f4c}, log id: 67000cb7 >2014-01-30 07:01:32,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6304d209 >2014-01-30 07:01:32,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6304d209 >2014-01-30 07:01:32,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 22df2b5b >2014-01-30 07:01:33,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22df2b5b >2014-01-30 07:01:38,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ecc738e >2014-01-30 07:01:38,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4ecc738e >2014-01-30 07:01:38,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 647df9e >2014-01-30 07:01:38,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae5c5a60, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@210b8fcc}, log id: 647df9e >2014-01-30 07:01:38,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7ed7103a >2014-01-30 07:01:39,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7ed7103a >2014-01-30 07:01:39,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 54a74258 >2014-01-30 07:01:39,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54a74258 >2014-01-30 07:01:41,048 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-1) [6b51df7a] No up server in cluster >2014-01-30 07:01:41,048 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-1) [6b51df7a] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:01:41,050 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-1) [6b51df7a] No up server in cluster >2014-01-30 07:01:41,050 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-1) [6b51df7a] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:01:41,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 6e605304 >2014-01-30 07:01:41,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 6e605304 >2014-01-30 07:01:41,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 690a3d04 >2014-01-30 07:01:41,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterTasksListVDSCommand, return: [], log id: 690a3d04 >2014-01-30 07:01:44,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36014fba >2014-01-30 07:01:45,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 36014fba >2014-01-30 07:01:45,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 650b57bd >2014-01-30 07:01:45,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd6677cf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@231fcc14}, log id: 650b57bd >2014-01-30 07:01:45,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ea4c094 >2014-01-30 07:01:45,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6ea4c094 >2014-01-30 07:01:45,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 72c5ad58 >2014-01-30 07:01:46,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72c5ad58 >2014-01-30 07:01:51,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3eeb6362 >2014-01-30 07:01:51,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3eeb6362 >2014-01-30 07:01:51,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 86b55b0 >2014-01-30 07:01:51,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c509261, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf5e73d}, log id: 86b55b0 >2014-01-30 07:01:51,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b7282bc >2014-01-30 07:01:52,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2b7282bc >2014-01-30 07:01:52,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 54e4ebbf >2014-01-30 07:01:52,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54e4ebbf >2014-01-30 07:01:57,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e2df670 >2014-01-30 07:01:58,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3e2df670 >2014-01-30 07:01:58,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67512885 >2014-01-30 07:01:58,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f10faa5a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e62abe27}, log id: 67512885 >2014-01-30 07:01:58,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 522263eb >2014-01-30 07:01:59,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 522263eb >2014-01-30 07:01:59,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 330f5c3f >2014-01-30 07:01:59,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 330f5c3f >2014-01-30 07:02:04,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49ea2871 >2014-01-30 07:02:04,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 49ea2871 >2014-01-30 07:02:04,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f6b7f0f >2014-01-30 07:02:05,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b86e3972, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a97a69b4}, log id: 3f6b7f0f >2014-01-30 07:02:05,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 21874cb6 >2014-01-30 07:02:05,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 21874cb6 >2014-01-30 07:02:05,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4ac13e65 >2014-01-30 07:02:05,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ac13e65 >2014-01-30 07:02:10,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 270baf93 >2014-01-30 07:02:11,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 270baf93 >2014-01-30 07:02:11,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a274d62 >2014-01-30 07:02:11,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac637109, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@631b51c8}, log id: 2a274d62 >2014-01-30 07:02:11,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d426b58 >2014-01-30 07:02:12,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: d426b58 >2014-01-30 07:02:12,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 36b338e1 >2014-01-30 07:02:12,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36b338e1 >2014-01-30 07:02:17,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12d3a338 >2014-01-30 07:02:17,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 12d3a338 >2014-01-30 07:02:17,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3719f39 >2014-01-30 07:02:18,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc9ca866, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@567be8b1}, log id: 3719f39 >2014-01-30 07:02:18,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4bd2c6b1 >2014-01-30 07:02:18,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4bd2c6b1 >2014-01-30 07:02:18,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 70c3a490 >2014-01-30 07:02:18,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70c3a490 >2014-01-30 07:02:23,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f2203f5 >2014-01-30 07:02:24,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2f2203f5 >2014-01-30 07:02:24,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44711ada >2014-01-30 07:02:24,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92cbbe92, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be389ad9}, log id: 44711ada >2014-01-30 07:02:24,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e7c7c62 >2014-01-30 07:02:25,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4e7c7c62 >2014-01-30 07:02:25,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2d0e7f54 >2014-01-30 07:02:25,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d0e7f54 >2014-01-30 07:02:30,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a9b5ec5 >2014-01-30 07:02:30,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a9b5ec5 >2014-01-30 07:02:31,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 61a4e09b >2014-01-30 07:02:31,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66d08a7a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b300316f}, log id: 61a4e09b >2014-01-30 07:02:31,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 489da39f >2014-01-30 07:02:31,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 489da39f >2014-01-30 07:02:31,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 49d66f2d >2014-01-30 07:02:32,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49d66f2d >2014-01-30 07:02:37,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c667429 >2014-01-30 07:02:37,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7c667429 >2014-01-30 07:02:37,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c34c970 >2014-01-30 07:02:37,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7537748f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f2c15f7e}, log id: 6c34c970 >2014-01-30 07:02:37,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2e0d916e >2014-01-30 07:02:38,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2e0d916e >2014-01-30 07:02:38,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 55a2bfa >2014-01-30 07:02:38,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55a2bfa >2014-01-30 07:02:41,872 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-61) [62f75f5f] No up server in cluster >2014-01-30 07:02:41,872 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-61) [62f75f5f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:02:41,875 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-61) [62f75f5f] No up server in cluster >2014-01-30 07:02:41,875 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-61) [62f75f5f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:02:41,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 4393ff92 >2014-01-30 07:02:42,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4393ff92 >2014-01-30 07:02:42,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 8e692f2 >2014-01-30 07:02:42,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterTasksListVDSCommand, return: [], log id: 8e692f2 >2014-01-30 07:02:43,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ea19a9a >2014-01-30 07:02:44,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: ea19a9a >2014-01-30 07:02:44,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d788018 >2014-01-30 07:02:44,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab129a79, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@387c666a}, log id: 2d788018 >2014-01-30 07:02:44,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6d9a75a4 >2014-01-30 07:02:44,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6d9a75a4 >2014-01-30 07:02:44,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 45391f6e >2014-01-30 07:02:45,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45391f6e >2014-01-30 07:02:50,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 134faf29 >2014-01-30 07:02:50,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 134faf29 >2014-01-30 07:02:50,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ced53a7 >2014-01-30 07:02:51,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@645254f7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8397e37}, log id: 3ced53a7 >2014-01-30 07:02:51,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4c44faed >2014-01-30 07:02:51,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4c44faed >2014-01-30 07:02:51,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 59ca3574 >2014-01-30 07:02:51,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59ca3574 >2014-01-30 07:02:56,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f2f3ff3 >2014-01-30 07:02:57,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f2f3ff3 >2014-01-30 07:02:57,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e8dfdf9 >2014-01-30 07:02:57,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94a91757, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb61b1d0}, log id: e8dfdf9 >2014-01-30 07:02:57,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5a41a8b7 >2014-01-30 07:02:58,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5a41a8b7 >2014-01-30 07:02:58,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 26fb4d0e >2014-01-30 07:02:58,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26fb4d0e >2014-01-30 07:03:03,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31e6b1f7 >2014-01-30 07:03:03,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 31e6b1f7 >2014-01-30 07:03:03,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29712eae >2014-01-30 07:03:04,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33d90bba, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95d51c7f}, log id: 29712eae >2014-01-30 07:03:04,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 644cb16c >2014-01-30 07:03:04,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 644cb16c >2014-01-30 07:03:04,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 46adc565 >2014-01-30 07:03:04,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46adc565 >2014-01-30 07:03:09,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d6b6e9c >2014-01-30 07:03:10,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: d6b6e9c >2014-01-30 07:03:10,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31a278e8 >2014-01-30 07:03:10,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48b188d7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de4d5280}, log id: 31a278e8 >2014-01-30 07:03:10,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 14c9ebdd >2014-01-30 07:03:11,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 14c9ebdd >2014-01-30 07:03:11,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 307faa6d >2014-01-30 07:03:11,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 307faa6d >2014-01-30 07:03:16,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f258fa >2014-01-30 07:03:16,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4f258fa >2014-01-30 07:03:16,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21252c2e >2014-01-30 07:03:17,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e53d4647, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1210b65b}, log id: 21252c2e >2014-01-30 07:03:17,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 45f531dc >2014-01-30 07:03:17,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 45f531dc >2014-01-30 07:03:17,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1a941f37 >2014-01-30 07:03:18,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a941f37 >2014-01-30 07:03:23,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 290e4392 >2014-01-30 07:03:23,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 290e4392 >2014-01-30 07:03:23,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2301856a >2014-01-30 07:03:23,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d64cd44e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d983b3bf}, log id: 2301856a >2014-01-30 07:03:23,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ea1316e >2014-01-30 07:03:24,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6ea1316e >2014-01-30 07:03:24,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7fcb5de2 >2014-01-30 07:03:24,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fcb5de2 >2014-01-30 07:03:29,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a59aed4 >2014-01-30 07:03:30,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a59aed4 >2014-01-30 07:03:30,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a2a2f20 >2014-01-30 07:03:30,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@739b5f7e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@976f2e4a}, log id: a2a2f20 >2014-01-30 07:03:30,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 30c43a7f >2014-01-30 07:03:30,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 30c43a7f >2014-01-30 07:03:30,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d9a9d95 >2014-01-30 07:03:31,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d9a9d95 >2014-01-30 07:03:36,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54e2b93 >2014-01-30 07:03:36,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 54e2b93 >2014-01-30 07:03:36,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a5239e1 >2014-01-30 07:03:36,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3350c33b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5862c23}, log id: 2a5239e1 >2014-01-30 07:03:36,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 139559db >2014-01-30 07:03:37,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 139559db >2014-01-30 07:03:37,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 346a0961 >2014-01-30 07:03:37,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 346a0961 >2014-01-30 07:03:42,700 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-89) [1642abb0] No up server in cluster >2014-01-30 07:03:42,700 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-89) [1642abb0] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:03:42,703 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-89) [1642abb0] No up server in cluster >2014-01-30 07:03:42,703 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-89) [1642abb0] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:03:42,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 17d7ccf3 >2014-01-30 07:03:42,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f5fbf06 >2014-01-30 07:03:43,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2f5fbf06 >2014-01-30 07:03:43,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d867a6 >2014-01-30 07:03:43,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 17d7ccf3 >2014-01-30 07:03:43,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 39447196 >2014-01-30 07:03:43,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@398266a5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d44b4d60}, log id: d867a6 >2014-01-30 07:03:43,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 26e94b02 >2014-01-30 07:03:43,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterTasksListVDSCommand, return: [], log id: 39447196 >2014-01-30 07:03:44,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 26e94b02 >2014-01-30 07:03:44,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 41b111ff >2014-01-30 07:03:44,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41b111ff >2014-01-30 07:03:49,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ada9f46 >2014-01-30 07:03:49,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5ada9f46 >2014-01-30 07:03:49,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2025e6ae >2014-01-30 07:03:50,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@faad88fa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac47a484}, log id: 2025e6ae >2014-01-30 07:03:50,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3a59a3ee >2014-01-30 07:03:50,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3a59a3ee >2014-01-30 07:03:50,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6b669388 >2014-01-30 07:03:50,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b669388 >2014-01-30 07:03:55,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72b69cf8 >2014-01-30 07:03:56,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 72b69cf8 >2014-01-30 07:03:56,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 63ba50f3 >2014-01-30 07:03:56,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c4670f0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e1d21f4}, log id: 63ba50f3 >2014-01-30 07:03:56,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4539fa9a >2014-01-30 07:03:57,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4539fa9a >2014-01-30 07:03:57,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 76079508 >2014-01-30 07:03:57,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 76079508 >2014-01-30 07:04:02,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 178f0897 >2014-01-30 07:04:02,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 178f0897 >2014-01-30 07:04:02,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5972c765 >2014-01-30 07:04:03,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@edaa8671, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9320076}, log id: 5972c765 >2014-01-30 07:04:03,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7e78f53c >2014-01-30 07:04:03,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7e78f53c >2014-01-30 07:04:03,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 64a1f70e >2014-01-30 07:04:03,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 64a1f70e >2014-01-30 07:04:08,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48111437 >2014-01-30 07:04:09,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 48111437 >2014-01-30 07:04:09,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6528c78 >2014-01-30 07:04:09,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f4fbe0f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fb34dac}, log id: 6528c78 >2014-01-30 07:04:09,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 421b4e6a >2014-01-30 07:04:10,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 421b4e6a >2014-01-30 07:04:10,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65b09d7a >2014-01-30 07:04:10,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65b09d7a >2014-01-30 07:04:15,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 363796a2 >2014-01-30 07:04:15,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 363796a2 >2014-01-30 07:04:16,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50e4a8a8 >2014-01-30 07:04:16,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8c80e42, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3f1ce55}, log id: 50e4a8a8 >2014-01-30 07:04:16,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6948e472 >2014-01-30 07:04:16,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6948e472 >2014-01-30 07:04:16,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77fda5ea >2014-01-30 07:04:17,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77fda5ea >2014-01-30 07:04:22,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d652b53 >2014-01-30 07:04:22,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7d652b53 >2014-01-30 07:04:22,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d875959 >2014-01-30 07:04:22,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37c29b7c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@406d837}, log id: 4d875959 >2014-01-30 07:04:22,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4d06576c >2014-01-30 07:04:23,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4d06576c >2014-01-30 07:04:23,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 41749379 >2014-01-30 07:04:23,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41749379 >2014-01-30 07:04:28,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2602c4bb >2014-01-30 07:04:29,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2602c4bb >2014-01-30 07:04:29,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6615180a >2014-01-30 07:04:29,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c1f964b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b1114f1}, log id: 6615180a >2014-01-30 07:04:29,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 43303059 >2014-01-30 07:04:29,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 43303059 >2014-01-30 07:04:29,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 73194b67 >2014-01-30 07:04:30,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73194b67 >2014-01-30 07:04:35,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 277954a0 >2014-01-30 07:04:35,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 277954a0 >2014-01-30 07:04:35,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 758fe6f4 >2014-01-30 07:04:36,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3325c40, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2db39718}, log id: 758fe6f4 >2014-01-30 07:04:36,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 163f031c >2014-01-30 07:04:36,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 163f031c >2014-01-30 07:04:36,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6d5e3028 >2014-01-30 07:04:36,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d5e3028 >2014-01-30 07:04:41,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f9568f3 >2014-01-30 07:04:42,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5f9568f3 >2014-01-30 07:04:42,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1565db2 >2014-01-30 07:04:42,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44621ce, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49bb4243}, log id: 1565db2 >2014-01-30 07:04:42,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 213f9796 >2014-01-30 07:04:43,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 213f9796 >2014-01-30 07:04:43,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 46c76759 >2014-01-30 07:04:43,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46c76759 >2014-01-30 07:04:43,705 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) [78fb20d6] No up server in cluster >2014-01-30 07:04:43,706 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) [78fb20d6] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:04:43,709 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-55) [78fb20d6] No up server in cluster >2014-01-30 07:04:43,709 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-55) [78fb20d6] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:04:43,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 137df2d3 >2014-01-30 07:04:44,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 137df2d3 >2014-01-30 07:04:44,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 12fb640e >2014-01-30 07:04:44,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterTasksListVDSCommand, return: [], log id: 12fb640e >2014-01-30 07:04:48,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25a4dc4c >2014-01-30 07:04:48,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 25a4dc4c >2014-01-30 07:04:48,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7777050b >2014-01-30 07:04:49,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45934887, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b65dfe92}, log id: 7777050b >2014-01-30 07:04:49,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 46284608 >2014-01-30 07:04:49,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 46284608 >2014-01-30 07:04:49,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1d3e6564 >2014-01-30 07:04:49,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d3e6564 >2014-01-30 07:04:54,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c0d9428 >2014-01-30 07:04:55,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c0d9428 >2014-01-30 07:04:55,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3909383d >2014-01-30 07:04:55,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0d0087a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84deab5a}, log id: 3909383d >2014-01-30 07:04:55,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7e0d2873 >2014-01-30 07:04:56,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7e0d2873 >2014-01-30 07:04:56,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 18d5bcbb >2014-01-30 07:04:56,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18d5bcbb >2014-01-30 07:05:01,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14643871 >2014-01-30 07:05:02,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 14643871 >2014-01-30 07:05:02,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58181d2d >2014-01-30 07:05:02,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce27ca6d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75d98477}, log id: 58181d2d >2014-01-30 07:05:02,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5199bba2 >2014-01-30 07:05:02,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5199bba2 >2014-01-30 07:05:02,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3a624935 >2014-01-30 07:05:03,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a624935 >2014-01-30 07:05:08,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a4a0a51 >2014-01-30 07:05:08,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1a4a0a51 >2014-01-30 07:05:08,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e7337b0 >2014-01-30 07:05:08,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d50c4154, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@450c9dcd}, log id: 4e7337b0 >2014-01-30 07:05:08,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2d97808 >2014-01-30 07:05:09,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2d97808 >2014-01-30 07:05:09,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 428eaf60 >2014-01-30 07:05:09,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 428eaf60 >2014-01-30 07:05:10,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c8ac85a >2014-01-30 07:05:10,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@40ff9573, log id: 4c8ac85a >2014-01-30 07:05:10,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4bacd25b >2014-01-30 07:05:10,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3efb0d91, log id: 4bacd25b >2014-01-30 07:05:14,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5670ec84 >2014-01-30 07:05:15,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5670ec84 >2014-01-30 07:05:15,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7320b40a >2014-01-30 07:05:15,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55e1d4d5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d463287b}, log id: 7320b40a >2014-01-30 07:05:15,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 27f9e244 >2014-01-30 07:05:15,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 27f9e244 >2014-01-30 07:05:16,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4aa0cb0d >2014-01-30 07:05:16,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4aa0cb0d >2014-01-30 07:05:21,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53499559 >2014-01-30 07:05:21,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 53499559 >2014-01-30 07:05:21,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 300fb7a6 >2014-01-30 07:05:22,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58875b47, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b11e90b}, log id: 300fb7a6 >2014-01-30 07:05:22,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4bb768e6 >2014-01-30 07:05:22,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4bb768e6 >2014-01-30 07:05:22,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d2a3692 >2014-01-30 07:05:22,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d2a3692 >2014-01-30 07:05:27,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36f06fea >2014-01-30 07:05:28,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 36f06fea >2014-01-30 07:05:28,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e363f47 >2014-01-30 07:05:28,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5310f37, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24feb7be}, log id: 5e363f47 >2014-01-30 07:05:28,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 25f766f3 >2014-01-30 07:05:29,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 25f766f3 >2014-01-30 07:05:29,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: fc5fee8 >2014-01-30 07:05:29,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: fc5fee8 >2014-01-30 07:05:34,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e194efa >2014-01-30 07:05:34,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7e194efa >2014-01-30 07:05:34,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c776a33 >2014-01-30 07:05:35,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a13d150b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0ea298f}, log id: 3c776a33 >2014-01-30 07:05:35,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5cb847fe >2014-01-30 07:05:35,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5cb847fe >2014-01-30 07:05:35,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 42850840 >2014-01-30 07:05:35,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 42850840 >2014-01-30 07:05:40,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15fc79d5 >2014-01-30 07:05:41,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 15fc79d5 >2014-01-30 07:05:41,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36f2a12e >2014-01-30 07:05:41,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ee22c16, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc0ab2b2}, log id: 36f2a12e >2014-01-30 07:05:41,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2257fb9a >2014-01-30 07:05:42,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2257fb9a >2014-01-30 07:05:42,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3f4a417a >2014-01-30 07:05:42,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f4a417a >2014-01-30 07:05:44,551 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-14) [511b856] No up server in cluster >2014-01-30 07:05:44,551 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:05:44,553 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-14) [511b856] No up server in cluster >2014-01-30 07:05:44,553 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-14) [511b856] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:05:44,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 540c790a >2014-01-30 07:05:45,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 540c790a >2014-01-30 07:05:45,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3e8526aa >2014-01-30 07:05:45,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterTasksListVDSCommand, return: [], log id: 3e8526aa >2014-01-30 07:05:47,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1dea26b9 >2014-01-30 07:05:48,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1dea26b9 >2014-01-30 07:05:48,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 400ae2c6 >2014-01-30 07:05:48,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11be90dc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4cd517bd}, log id: 400ae2c6 >2014-01-30 07:05:48,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 435dd90 >2014-01-30 07:05:48,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 435dd90 >2014-01-30 07:05:48,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 654e28f4 >2014-01-30 07:05:49,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 654e28f4 >2014-01-30 07:05:54,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30ba1a49 >2014-01-30 07:05:54,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 30ba1a49 >2014-01-30 07:05:54,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f4c4df5 >2014-01-30 07:05:54,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69d241f9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa5efd06}, log id: 4f4c4df5 >2014-01-30 07:05:54,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 48c4cfda >2014-01-30 07:05:55,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 48c4cfda >2014-01-30 07:05:55,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 68c34b5 >2014-01-30 07:05:55,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68c34b5 >2014-01-30 07:06:00,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 223cceca >2014-01-30 07:06:01,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 223cceca >2014-01-30 07:06:01,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74983238 >2014-01-30 07:06:01,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ba7120a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ee8e30a}, log id: 74983238 >2014-01-30 07:06:01,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: b9c566d >2014-01-30 07:06:01,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: b9c566d >2014-01-30 07:06:01,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 712b62d2 >2014-01-30 07:06:02,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 712b62d2 >2014-01-30 07:06:07,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56c72a4b >2014-01-30 07:06:07,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 56c72a4b >2014-01-30 07:06:07,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35226e19 >2014-01-30 07:06:08,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f91c415, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd2ce2e7}, log id: 35226e19 >2014-01-30 07:06:08,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 42db8454 >2014-01-30 07:06:08,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 42db8454 >2014-01-30 07:06:08,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 54440f19 >2014-01-30 07:06:08,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54440f19 >2014-01-30 07:06:13,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50273765 >2014-01-30 07:06:14,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 50273765 >2014-01-30 07:06:14,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 681d724f >2014-01-30 07:06:14,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ccff5c2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a40ea5fb}, log id: 681d724f >2014-01-30 07:06:14,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6c912e13 >2014-01-30 07:06:15,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6c912e13 >2014-01-30 07:06:15,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2c770a6f >2014-01-30 07:06:15,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c770a6f >2014-01-30 07:06:20,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 34c1a86b >2014-01-30 07:06:20,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 34c1a86b >2014-01-30 07:06:20,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a18b66a >2014-01-30 07:06:21,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@805b9cf2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6bac6e6b}, log id: 1a18b66a >2014-01-30 07:06:21,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6260ac86 >2014-01-30 07:06:21,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6260ac86 >2014-01-30 07:06:21,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6c661c7b >2014-01-30 07:06:21,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c661c7b >2014-01-30 07:06:26,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 479983eb >2014-01-30 07:06:27,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 479983eb >2014-01-30 07:06:27,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21073903 >2014-01-30 07:06:27,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81dce95a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b8ff6f0}, log id: 21073903 >2014-01-30 07:06:27,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 21d358b >2014-01-30 07:06:28,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 21d358b >2014-01-30 07:06:28,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3a52415 >2014-01-30 07:06:28,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a52415 >2014-01-30 07:06:33,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b0d0384 >2014-01-30 07:06:33,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2b0d0384 >2014-01-30 07:06:33,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3503add6 >2014-01-30 07:06:34,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60d0cec2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ffba3e7}, log id: 3503add6 >2014-01-30 07:06:34,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 431ac5a >2014-01-30 07:06:34,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 431ac5a >2014-01-30 07:06:34,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 247fc1f4 >2014-01-30 07:06:34,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 247fc1f4 >2014-01-30 07:06:39,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10da39e2 >2014-01-30 07:06:40,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 10da39e2 >2014-01-30 07:06:40,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 380d6e02 >2014-01-30 07:06:40,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2a8c298, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9bb3e90}, log id: 380d6e02 >2014-01-30 07:06:40,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5699dcb2 >2014-01-30 07:06:41,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5699dcb2 >2014-01-30 07:06:41,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5ec77f5a >2014-01-30 07:06:41,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ec77f5a >2014-01-30 07:06:45,349 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-84) [2ccca513] No up server in cluster >2014-01-30 07:06:45,349 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-84) [2ccca513] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:06:45,352 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-84) [2ccca513] No up server in cluster >2014-01-30 07:06:45,353 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-84) [2ccca513] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:06:45,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 630590f7 >2014-01-30 07:06:45,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 630590f7 >2014-01-30 07:06:45,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 5a5f2d6 >2014-01-30 07:06:46,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterTasksListVDSCommand, return: [], log id: 5a5f2d6 >2014-01-30 07:06:46,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b1a6187 >2014-01-30 07:06:46,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3b1a6187 >2014-01-30 07:06:47,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1cae9e44 >2014-01-30 07:06:47,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9df4410, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7b516cc}, log id: 1cae9e44 >2014-01-30 07:06:47,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 196d7588 >2014-01-30 07:06:47,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 196d7588 >2014-01-30 07:06:47,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 636c6ea4 >2014-01-30 07:06:48,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 636c6ea4 >2014-01-30 07:06:53,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 394a50fb >2014-01-30 07:06:53,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 394a50fb >2014-01-30 07:06:53,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68bc3f0 >2014-01-30 07:06:53,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f5d8b98, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7509530}, log id: 68bc3f0 >2014-01-30 07:06:53,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1f283e60 >2014-01-30 07:06:54,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1f283e60 >2014-01-30 07:06:54,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5b4b9abc >2014-01-30 07:06:54,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b4b9abc >2014-01-30 07:06:59,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36af18a2 >2014-01-30 07:07:00,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 36af18a2 >2014-01-30 07:07:00,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58bf5de >2014-01-30 07:07:00,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b47bdac7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@598f0e89}, log id: 58bf5de >2014-01-30 07:07:00,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2d23ac27 >2014-01-30 07:07:00,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2d23ac27 >2014-01-30 07:07:00,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 36986500 >2014-01-30 07:07:01,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36986500 >2014-01-30 07:07:06,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48f5d88c >2014-01-30 07:07:06,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 48f5d88c >2014-01-30 07:07:06,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c9655b6 >2014-01-30 07:07:06,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17b36f2a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96c9133e}, log id: 1c9655b6 >2014-01-30 07:07:07,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 106dfc97 >2014-01-30 07:07:07,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 106dfc97 >2014-01-30 07:07:07,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 62afb5e4 >2014-01-30 07:07:07,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62afb5e4 >2014-01-30 07:07:12,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2166ae74 >2014-01-30 07:07:13,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2166ae74 >2014-01-30 07:07:13,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 763ffbc9 >2014-01-30 07:07:13,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5bb74f5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1521875b}, log id: 763ffbc9 >2014-01-30 07:07:13,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4848d7c9 >2014-01-30 07:07:14,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4848d7c9 >2014-01-30 07:07:14,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: eff5513 >2014-01-30 07:07:14,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: eff5513 >2014-01-30 07:07:19,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e01136b >2014-01-30 07:07:19,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e01136b >2014-01-30 07:07:19,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 649bc571 >2014-01-30 07:07:20,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fbefa655, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d9e8a6b}, log id: 649bc571 >2014-01-30 07:07:20,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4a7d0e68 >2014-01-30 07:07:20,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4a7d0e68 >2014-01-30 07:07:20,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 657c37d3 >2014-01-30 07:07:20,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 657c37d3 >2014-01-30 07:07:25,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3db3d224 >2014-01-30 07:07:26,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3db3d224 >2014-01-30 07:07:26,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1288109f >2014-01-30 07:07:26,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f34d07f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a207d0}, log id: 1288109f >2014-01-30 07:07:26,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 50def26 >2014-01-30 07:07:27,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 50def26 >2014-01-30 07:07:27,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4517236c >2014-01-30 07:07:27,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4517236c >2014-01-30 07:07:32,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32ae99e >2014-01-30 07:07:32,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 32ae99e >2014-01-30 07:07:32,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58796ffe >2014-01-30 07:07:33,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56f28601, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@745261c3}, log id: 58796ffe >2014-01-30 07:07:33,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ff9bf10 >2014-01-30 07:07:33,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6ff9bf10 >2014-01-30 07:07:33,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7403dd53 >2014-01-30 07:07:33,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7403dd53 >2014-01-30 07:07:38,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ec7d7d3 >2014-01-30 07:07:39,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3ec7d7d3 >2014-01-30 07:07:39,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59b1fa0f >2014-01-30 07:07:39,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8917d32b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b30d269}, log id: 59b1fa0f >2014-01-30 07:07:39,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 26598404 >2014-01-30 07:07:40,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 26598404 >2014-01-30 07:07:40,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 16521eb >2014-01-30 07:07:40,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16521eb >2014-01-30 07:07:45,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50971e01 >2014-01-30 07:07:46,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 50971e01 >2014-01-30 07:07:46,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1fffb90c >2014-01-30 07:07:46,156 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-69) No up server in cluster >2014-01-30 07:07:46,156 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-69) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:07:46,158 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-69) No up server in cluster >2014-01-30 07:07:46,158 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-69) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:07:46,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 343d0e90 >2014-01-30 07:07:46,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@659d82a7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89f4757c}, log id: 1fffb90c >2014-01-30 07:07:46,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 66793cde >2014-01-30 07:07:46,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 343d0e90 >2014-01-30 07:07:46,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 7434de45 >2014-01-30 07:07:46,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 66793cde >2014-01-30 07:07:46,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b31fd0a >2014-01-30 07:07:46,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7434de45 >2014-01-30 07:07:46,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b31fd0a >2014-01-30 07:07:52,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d3560f1 >2014-01-30 07:07:52,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7d3560f1 >2014-01-30 07:07:52,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 73e7a9ad >2014-01-30 07:07:52,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb3be39b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@855751cd}, log id: 73e7a9ad >2014-01-30 07:07:52,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 327446cb >2014-01-30 07:07:53,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 327446cb >2014-01-30 07:07:53,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7f393415 >2014-01-30 07:07:53,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f393415 >2014-01-30 07:07:58,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 63c65c96 >2014-01-30 07:07:59,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 63c65c96 >2014-01-30 07:07:59,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3386e395 >2014-01-30 07:07:59,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a0878ee, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c44b0006}, log id: 3386e395 >2014-01-30 07:07:59,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 275bb6f9 >2014-01-30 07:07:59,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 275bb6f9 >2014-01-30 07:07:59,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6d690e63 >2014-01-30 07:08:00,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d690e63 >2014-01-30 07:08:05,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 241a7785 >2014-01-30 07:08:05,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 241a7785 >2014-01-30 07:08:05,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4aa5756d >2014-01-30 07:08:05,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@101c8e15, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b93fcb2}, log id: 4aa5756d >2014-01-30 07:08:05,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 252e5274 >2014-01-30 07:08:06,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 252e5274 >2014-01-30 07:08:06,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 31e78d99 >2014-01-30 07:08:06,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31e78d99 >2014-01-30 07:08:11,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64ff1828 >2014-01-30 07:08:12,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 64ff1828 >2014-01-30 07:08:12,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c942af0 >2014-01-30 07:08:12,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd95f369, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22160583}, log id: 2c942af0 >2014-01-30 07:08:12,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 54b63914 >2014-01-30 07:08:13,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 54b63914 >2014-01-30 07:08:13,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5fcfad65 >2014-01-30 07:08:13,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fcfad65 >2014-01-30 07:08:18,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ea321df >2014-01-30 07:08:18,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4ea321df >2014-01-30 07:08:18,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1bfc4ce >2014-01-30 07:08:19,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87b6dda5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97512e5a}, log id: 1bfc4ce >2014-01-30 07:08:19,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3f98a86b >2014-01-30 07:08:19,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3f98a86b >2014-01-30 07:08:19,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6089be7d >2014-01-30 07:08:19,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6089be7d >2014-01-30 07:08:24,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c26f2fd >2014-01-30 07:08:25,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1c26f2fd >2014-01-30 07:08:25,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d42ae24 >2014-01-30 07:08:25,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66ddcb54, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@592032cb}, log id: 3d42ae24 >2014-01-30 07:08:25,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 155c0896 >2014-01-30 07:08:26,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 155c0896 >2014-01-30 07:08:26,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2c425c53 >2014-01-30 07:08:26,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c425c53 >2014-01-30 07:08:31,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 634892c5 >2014-01-30 07:08:31,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 634892c5 >2014-01-30 07:08:31,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 299f094d >2014-01-30 07:08:32,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56238940, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@628db7f3}, log id: 299f094d >2014-01-30 07:08:32,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 23a916bc >2014-01-30 07:08:32,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 23a916bc >2014-01-30 07:08:32,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 724ebcd4 >2014-01-30 07:08:32,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 724ebcd4 >2014-01-30 07:08:37,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17c3439 >2014-01-30 07:08:38,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 17c3439 >2014-01-30 07:08:38,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25e2023d >2014-01-30 07:08:38,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bb76a2f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ad475a4}, log id: 25e2023d >2014-01-30 07:08:38,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1f1d725d >2014-01-30 07:08:39,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1f1d725d >2014-01-30 07:08:39,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 19827567 >2014-01-30 07:08:39,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19827567 >2014-01-30 07:08:44,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 494bf24c >2014-01-30 07:08:45,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 494bf24c >2014-01-30 07:08:45,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36cdcb31 >2014-01-30 07:08:45,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87645f55, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5367cc0}, log id: 36cdcb31 >2014-01-30 07:08:45,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 42915fb4 >2014-01-30 07:08:45,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 42915fb4 >2014-01-30 07:08:45,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3584231 >2014-01-30 07:08:46,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3584231 >2014-01-30 07:08:46,939 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-99) [63a33dd9] No up server in cluster >2014-01-30 07:08:46,939 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:08:46,942 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-99) [63a33dd9] No up server in cluster >2014-01-30 07:08:46,942 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:08:46,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 713355d >2014-01-30 07:08:47,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 713355d >2014-01-30 07:08:47,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 44353ae0 >2014-01-30 07:08:47,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterTasksListVDSCommand, return: [], log id: 44353ae0 >2014-01-30 07:08:51,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: aaa2f5d >2014-01-30 07:08:51,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: aaa2f5d >2014-01-30 07:08:51,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49d540dc >2014-01-30 07:08:51,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a98f6c5c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ad1c702}, log id: 49d540dc >2014-01-30 07:08:51,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2793a169 >2014-01-30 07:08:52,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2793a169 >2014-01-30 07:08:52,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 671c4912 >2014-01-30 07:08:52,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 671c4912 >2014-01-30 07:08:57,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66ae3ff9 >2014-01-30 07:08:58,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 66ae3ff9 >2014-01-30 07:08:58,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d77dc7c >2014-01-30 07:08:58,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72cc0d87, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@126ffd84}, log id: 4d77dc7c >2014-01-30 07:08:58,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 42b63c5e >2014-01-30 07:08:58,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 42b63c5e >2014-01-30 07:08:58,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6548821 >2014-01-30 07:08:59,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6548821 >2014-01-30 07:09:04,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2048b732 >2014-01-30 07:09:04,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2048b732 >2014-01-30 07:09:04,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7856561c >2014-01-30 07:09:04,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76289a1a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4407e8a1}, log id: 7856561c >2014-01-30 07:09:05,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 456b39fb >2014-01-30 07:09:05,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 456b39fb >2014-01-30 07:09:05,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 186a892e >2014-01-30 07:09:05,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 186a892e >2014-01-30 07:09:10,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e6c6876 >2014-01-30 07:09:11,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4e6c6876 >2014-01-30 07:09:11,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 450a819c >2014-01-30 07:09:11,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f853294b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb7e7ea9}, log id: 450a819c >2014-01-30 07:09:11,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3468d406 >2014-01-30 07:09:12,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3468d406 >2014-01-30 07:09:12,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6e206fb8 >2014-01-30 07:09:12,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e206fb8 >2014-01-30 07:09:17,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44f19e71 >2014-01-30 07:09:17,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 44f19e71 >2014-01-30 07:09:17,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e58f1ea >2014-01-30 07:09:18,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bca2cf97, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78a37e21}, log id: 7e58f1ea >2014-01-30 07:09:18,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ffd548 >2014-01-30 07:09:18,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6ffd548 >2014-01-30 07:09:18,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 19b4679a >2014-01-30 07:09:18,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19b4679a >2014-01-30 07:09:23,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32779163 >2014-01-30 07:09:24,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 32779163 >2014-01-30 07:09:24,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f6816d9 >2014-01-30 07:09:24,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c68f422, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c081f72}, log id: 1f6816d9 >2014-01-30 07:09:24,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6db22a15 >2014-01-30 07:09:25,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6db22a15 >2014-01-30 07:09:25,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6f13fa68 >2014-01-30 07:09:25,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f13fa68 >2014-01-30 07:09:30,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c6b22ac >2014-01-30 07:09:30,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7c6b22ac >2014-01-30 07:09:31,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b94caa0 >2014-01-30 07:09:31,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9a3da25, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3de81eff}, log id: 7b94caa0 >2014-01-30 07:09:31,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1905a752 >2014-01-30 07:09:31,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1905a752 >2014-01-30 07:09:31,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6c36ccd2 >2014-01-30 07:09:32,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c36ccd2 >2014-01-30 07:09:37,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3696d040 >2014-01-30 07:09:37,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3696d040 >2014-01-30 07:09:37,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f470b87 >2014-01-30 07:09:37,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c74bb89, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@693fcc07}, log id: f470b87 >2014-01-30 07:09:37,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 13e9b863 >2014-01-30 07:09:38,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 13e9b863 >2014-01-30 07:09:38,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 24af3aec >2014-01-30 07:09:38,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24af3aec >2014-01-30 07:09:43,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ee4211a >2014-01-30 07:09:44,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4ee4211a >2014-01-30 07:09:44,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a73b741 >2014-01-30 07:09:44,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bac51f5e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54c2e0cf}, log id: 1a73b741 >2014-01-30 07:09:44,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1418e972 >2014-01-30 07:09:44,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1418e972 >2014-01-30 07:09:44,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5e60267d >2014-01-30 07:09:45,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e60267d >2014-01-30 07:09:47,775 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-97) [717bad08] No up server in cluster >2014-01-30 07:09:47,776 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-97) [717bad08] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:09:47,779 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-97) [717bad08] No up server in cluster >2014-01-30 07:09:47,779 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-97) [717bad08] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:09:47,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 6d986aab >2014-01-30 07:09:48,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 6d986aab >2014-01-30 07:09:48,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 2cd5fb4f >2014-01-30 07:09:48,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterTasksListVDSCommand, return: [], log id: 2cd5fb4f >2014-01-30 07:09:50,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33afc703 >2014-01-30 07:09:50,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 33afc703 >2014-01-30 07:09:50,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22af630c >2014-01-30 07:09:50,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39309d0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3efba3a}, log id: 22af630c >2014-01-30 07:09:51,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ea97b6a >2014-01-30 07:09:51,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3ea97b6a >2014-01-30 07:09:51,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: f61a2e0 >2014-01-30 07:09:51,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f61a2e0 >2014-01-30 07:09:56,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d7131f1 >2014-01-30 07:09:57,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6d7131f1 >2014-01-30 07:09:57,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e5c35fd >2014-01-30 07:09:57,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4caf4275, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81a61285}, log id: 7e5c35fd >2014-01-30 07:09:57,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 739aa459 >2014-01-30 07:09:58,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 739aa459 >2014-01-30 07:09:58,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 778fa62f >2014-01-30 07:09:58,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 778fa62f >2014-01-30 07:10:03,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 745e4e5d >2014-01-30 07:10:03,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 745e4e5d >2014-01-30 07:10:03,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e1aa51a >2014-01-30 07:10:04,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8da5fd59, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12ee89a6}, log id: 5e1aa51a >2014-01-30 07:10:04,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 194dc7ce >2014-01-30 07:10:04,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 194dc7ce >2014-01-30 07:10:04,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ee7f545 >2014-01-30 07:10:04,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ee7f545 >2014-01-30 07:10:09,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78a63e67 >2014-01-30 07:10:10,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 78a63e67 >2014-01-30 07:10:10,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a584228 >2014-01-30 07:10:10,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a048e3cc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84eaa2b5}, log id: 6a584228 >2014-01-30 07:10:10,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 601a205e >2014-01-30 07:10:10,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11f2ba37 >2014-01-30 07:10:11,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 601a205e >2014-01-30 07:10:11,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1ded8743 >2014-01-30 07:10:11,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@50c3f6f9, log id: 11f2ba37 >2014-01-30 07:10:11,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 718b7edb >2014-01-30 07:10:11,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1ded8743 >2014-01-30 07:10:11,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@30635512, log id: 718b7edb >2014-01-30 07:10:16,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 283492b1 >2014-01-30 07:10:16,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 283492b1 >2014-01-30 07:10:16,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: bf6ea01 >2014-01-30 07:10:17,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31adc9c8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d258f406}, log id: bf6ea01 >2014-01-30 07:10:17,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 68153121 >2014-01-30 07:10:17,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 68153121 >2014-01-30 07:10:17,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ba752cb >2014-01-30 07:10:17,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ba752cb >2014-01-30 07:10:22,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53b72c65 >2014-01-30 07:10:23,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 53b72c65 >2014-01-30 07:10:23,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a901bc4 >2014-01-30 07:10:23,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf7157d5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77f84159}, log id: 3a901bc4 >2014-01-30 07:10:23,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 62d64949 >2014-01-30 07:10:24,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 62d64949 >2014-01-30 07:10:24,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3bdb7fa2 >2014-01-30 07:10:24,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bdb7fa2 >2014-01-30 07:10:29,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 108c507e >2014-01-30 07:10:30,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 108c507e >2014-01-30 07:10:30,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7511c8db >2014-01-30 07:10:30,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cbbd070, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ded7d880}, log id: 7511c8db >2014-01-30 07:10:30,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c9bcb87 >2014-01-30 07:10:30,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5c9bcb87 >2014-01-30 07:10:30,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4415d58c >2014-01-30 07:10:31,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4415d58c >2014-01-30 07:10:36,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d98399f >2014-01-30 07:10:36,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7d98399f >2014-01-30 07:10:36,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 510d0350 >2014-01-30 07:10:36,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@973d3305, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@302cea89}, log id: 510d0350 >2014-01-30 07:10:36,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 51c98f67 >2014-01-30 07:10:37,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 51c98f67 >2014-01-30 07:10:37,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6f0e4f33 >2014-01-30 07:10:37,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6f0e4f33 >2014-01-30 07:10:42,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20f1becc >2014-01-30 07:10:43,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 20f1becc >2014-01-30 07:10:43,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 480319d7 >2014-01-30 07:10:43,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e983a6fb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@554973c5}, log id: 480319d7 >2014-01-30 07:10:43,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4f417d00 >2014-01-30 07:10:43,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4f417d00 >2014-01-30 07:10:43,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4c063760 >2014-01-30 07:10:44,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c063760 >2014-01-30 07:10:48,607 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-59) [499ce58b] No up server in cluster >2014-01-30 07:10:48,607 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-59) [499ce58b] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:10:48,610 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-59) [499ce58b] No up server in cluster >2014-01-30 07:10:48,610 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-59) [499ce58b] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:10:48,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: dc81c62 >2014-01-30 07:10:49,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: dc81c62 >2014-01-30 07:10:49,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 77c61f4c >2014-01-30 07:10:49,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c04dfeb >2014-01-30 07:10:49,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterTasksListVDSCommand, return: [], log id: 77c61f4c >2014-01-30 07:10:49,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7c04dfeb >2014-01-30 07:10:49,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c58824 >2014-01-30 07:10:50,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa5ddad7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f76da5d4}, log id: 6c58824 >2014-01-30 07:10:50,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 37665436 >2014-01-30 07:10:50,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 37665436 >2014-01-30 07:10:50,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1c667bb0 >2014-01-30 07:10:50,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c667bb0 >2014-01-30 07:10:55,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 276e9dc5 >2014-01-30 07:10:56,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 276e9dc5 >2014-01-30 07:10:56,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2237c89c >2014-01-30 07:10:56,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b7c4ecb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@299cafe5}, log id: 2237c89c >2014-01-30 07:10:56,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ad7c857 >2014-01-30 07:10:57,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6ad7c857 >2014-01-30 07:10:57,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ceea56d >2014-01-30 07:10:57,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ceea56d >2014-01-30 07:11:02,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d7ede64 >2014-01-30 07:11:02,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3d7ede64 >2014-01-30 07:11:02,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 39429c2e >2014-01-30 07:11:03,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@715327e2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffb567f6}, log id: 39429c2e >2014-01-30 07:11:03,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 736a391d >2014-01-30 07:11:03,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 736a391d >2014-01-30 07:11:03,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 89be16e >2014-01-30 07:11:03,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 89be16e >2014-01-30 07:11:08,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e53b234 >2014-01-30 07:11:09,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e53b234 >2014-01-30 07:11:09,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13d868e4 >2014-01-30 07:11:09,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94282b4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3ec7e6}, log id: 13d868e4 >2014-01-30 07:11:09,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 728f8386 >2014-01-30 07:11:10,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 728f8386 >2014-01-30 07:11:10,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2a24df4f >2014-01-30 07:11:10,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a24df4f >2014-01-30 07:11:15,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: af5022b >2014-01-30 07:11:16,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: af5022b >2014-01-30 07:11:16,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a42e022 >2014-01-30 07:11:16,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ed8b21f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83529c0c}, log id: 3a42e022 >2014-01-30 07:11:16,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 526121ca >2014-01-30 07:11:16,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 526121ca >2014-01-30 07:11:16,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2ad8198a >2014-01-30 07:11:17,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ad8198a >2014-01-30 07:11:22,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ca9805 >2014-01-30 07:11:22,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1ca9805 >2014-01-30 07:11:22,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a3cd47d >2014-01-30 07:11:22,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18c8b88c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88b24759}, log id: 7a3cd47d >2014-01-30 07:11:22,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5bafc120 >2014-01-30 07:11:23,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5bafc120 >2014-01-30 07:11:23,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3891445 >2014-01-30 07:11:23,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3891445 >2014-01-30 07:11:28,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6527b8 >2014-01-30 07:11:29,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6527b8 >2014-01-30 07:11:29,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3beea994 >2014-01-30 07:11:29,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6a5933e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3ea8e2e}, log id: 3beea994 >2014-01-30 07:11:29,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7dc34ca9 >2014-01-30 07:11:29,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7dc34ca9 >2014-01-30 07:11:29,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5b4b856 >2014-01-30 07:11:30,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b4b856 >2014-01-30 07:11:35,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 697dfd36 >2014-01-30 07:11:35,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 697dfd36 >2014-01-30 07:11:35,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2bdf9f3b >2014-01-30 07:11:35,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60d5b9f3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d71b49f}, log id: 2bdf9f3b >2014-01-30 07:11:35,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 58360cf4 >2014-01-30 07:11:36,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 58360cf4 >2014-01-30 07:11:36,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 584650f8 >2014-01-30 07:11:36,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 584650f8 >2014-01-30 07:11:41,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e583bd3 >2014-01-30 07:11:42,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6e583bd3 >2014-01-30 07:11:42,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6abd04cc >2014-01-30 07:11:42,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30314980, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5752899b}, log id: 6abd04cc >2014-01-30 07:11:42,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e266a79 >2014-01-30 07:11:43,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4e266a79 >2014-01-30 07:11:43,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 34efd00c >2014-01-30 07:11:43,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34efd00c >2014-01-30 07:11:48,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74cdc575 >2014-01-30 07:11:48,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 74cdc575 >2014-01-30 07:11:48,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 691d3ee8 >2014-01-30 07:11:49,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fd88096, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f1eb27}, log id: 691d3ee8 >2014-01-30 07:11:49,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 114c3019 >2014-01-30 07:11:49,428 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] No up server in cluster >2014-01-30 07:11:49,428 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:11:49,430 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] No up server in cluster >2014-01-30 07:11:49,430 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:11:49,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 42a55299 >2014-01-30 07:11:49,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 114c3019 >2014-01-30 07:11:49,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 685354de >2014-01-30 07:11:49,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 685354de >2014-01-30 07:11:49,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 42a55299 >2014-01-30 07:11:49,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 58258606 >2014-01-30 07:11:50,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterTasksListVDSCommand, return: [], log id: 58258606 >2014-01-30 07:11:54,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6db99b81 >2014-01-30 07:11:55,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6db99b81 >2014-01-30 07:11:55,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a8e0837 >2014-01-30 07:11:55,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eaab1776, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38b54024}, log id: 4a8e0837 >2014-01-30 07:11:55,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3a5d0c19 >2014-01-30 07:11:56,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3a5d0c19 >2014-01-30 07:11:56,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 15a32f44 >2014-01-30 07:11:56,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15a32f44 >2014-01-30 07:12:01,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 307245e3 >2014-01-30 07:12:01,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 307245e3 >2014-01-30 07:12:01,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42c79bc8 >2014-01-30 07:12:02,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@696a60fa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db36c1c6}, log id: 42c79bc8 >2014-01-30 07:12:02,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 757e7e78 >2014-01-30 07:12:02,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 757e7e78 >2014-01-30 07:12:02,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2312ca98 >2014-01-30 07:12:02,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2312ca98 >2014-01-30 07:12:07,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e36d964 >2014-01-30 07:12:08,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: e36d964 >2014-01-30 07:12:08,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a716778 >2014-01-30 07:12:08,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd6123e7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e48f6c8}, log id: 4a716778 >2014-01-30 07:12:08,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7f920085 >2014-01-30 07:12:09,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7f920085 >2014-01-30 07:12:09,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: e5e12a0 >2014-01-30 07:12:09,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e5e12a0 >2014-01-30 07:12:14,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f0a001 >2014-01-30 07:12:14,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5f0a001 >2014-01-30 07:12:14,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 39728d8e >2014-01-30 07:12:15,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6545b22, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@332da4b3}, log id: 39728d8e >2014-01-30 07:12:15,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5b3e98fb >2014-01-30 07:12:15,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5b3e98fb >2014-01-30 07:12:15,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 21c2f211 >2014-01-30 07:12:16,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21c2f211 >2014-01-30 07:12:21,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ab60fa1 >2014-01-30 07:12:21,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3ab60fa1 >2014-01-30 07:12:21,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2be059c5 >2014-01-30 07:12:21,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26e723b9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4df2a5b}, log id: 2be059c5 >2014-01-30 07:12:21,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3c47d495 >2014-01-30 07:12:22,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3c47d495 >2014-01-30 07:12:22,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5000e291 >2014-01-30 07:12:22,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5000e291 >2014-01-30 07:12:27,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ba2fd78 >2014-01-30 07:12:28,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6ba2fd78 >2014-01-30 07:12:28,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44bc24d9 >2014-01-30 07:12:28,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6c283b4e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6afec734}, log id: 44bc24d9 >2014-01-30 07:12:28,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: e77f6e2 >2014-01-30 07:12:28,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: e77f6e2 >2014-01-30 07:12:28,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7e3edbb0 >2014-01-30 07:12:29,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e3edbb0 >2014-01-30 07:12:34,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b4da6b3 >2014-01-30 07:12:34,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b4da6b3 >2014-01-30 07:12:34,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 327d7b8 >2014-01-30 07:12:34,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae2540, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cd6b6e3}, log id: 327d7b8 >2014-01-30 07:12:34,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 50f4ebde >2014-01-30 07:12:35,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 50f4ebde >2014-01-30 07:12:35,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 389db7c5 >2014-01-30 07:12:35,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 389db7c5 >2014-01-30 07:12:40,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 251209f7 >2014-01-30 07:12:41,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 251209f7 >2014-01-30 07:12:41,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b92b49e >2014-01-30 07:12:41,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c21a867a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b218ce}, log id: 5b92b49e >2014-01-30 07:12:41,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 60a2c1ae >2014-01-30 07:12:41,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 60a2c1ae >2014-01-30 07:12:41,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 72887613 >2014-01-30 07:12:42,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72887613 >2014-01-30 07:12:47,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20794e0f >2014-01-30 07:12:47,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 20794e0f >2014-01-30 07:12:47,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f4c54a1 >2014-01-30 07:12:48,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5cc89346, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e90ce089}, log id: 4f4c54a1 >2014-01-30 07:12:48,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1631fa5f >2014-01-30 07:12:48,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1631fa5f >2014-01-30 07:12:48,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5f4dbbed >2014-01-30 07:12:48,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f4dbbed >2014-01-30 07:12:50,250 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-91) [51ec2212] No up server in cluster >2014-01-30 07:12:50,250 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-91) [51ec2212] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:12:50,253 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-91) [51ec2212] No up server in cluster >2014-01-30 07:12:50,253 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-91) [51ec2212] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:12:50,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: f526c53 >2014-01-30 07:12:50,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: f526c53 >2014-01-30 07:12:50,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 22d05de8 >2014-01-30 07:12:51,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterTasksListVDSCommand, return: [], log id: 22d05de8 >2014-01-30 07:12:53,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 499a9b3b >2014-01-30 07:12:54,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 499a9b3b >2014-01-30 07:12:54,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 47e6e252 >2014-01-30 07:12:54,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19a2ca64, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@430aad47}, log id: 47e6e252 >2014-01-30 07:12:54,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 416abeb2 >2014-01-30 07:12:55,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 416abeb2 >2014-01-30 07:12:55,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a8c0d66 >2014-01-30 07:12:55,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a8c0d66 >2014-01-30 07:13:00,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 315f5f95 >2014-01-30 07:13:00,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 315f5f95 >2014-01-30 07:13:00,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5274996c >2014-01-30 07:13:01,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2497f3f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36ff2d17}, log id: 5274996c >2014-01-30 07:13:01,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 47c3d88e >2014-01-30 07:13:01,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 47c3d88e >2014-01-30 07:13:01,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4b15ae7b >2014-01-30 07:13:01,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4b15ae7b >2014-01-30 07:13:06,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c2d4805 >2014-01-30 07:13:07,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1c2d4805 >2014-01-30 07:13:07,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 870d299 >2014-01-30 07:13:07,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61a14ee5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@187bc56e}, log id: 870d299 >2014-01-30 07:13:07,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ca6e03f >2014-01-30 07:13:08,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: ca6e03f >2014-01-30 07:13:08,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3519cd6d >2014-01-30 07:13:08,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3519cd6d >2014-01-30 07:13:13,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a8a5207 >2014-01-30 07:13:13,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4a8a5207 >2014-01-30 07:13:13,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19175845 >2014-01-30 07:13:14,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff803250, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e972c397}, log id: 19175845 >2014-01-30 07:13:14,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7bbed23c >2014-01-30 07:13:14,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7bbed23c >2014-01-30 07:13:14,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 48eb6fdc >2014-01-30 07:13:14,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48eb6fdc >2014-01-30 07:13:19,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 565ef87e >2014-01-30 07:13:20,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 565ef87e >2014-01-30 07:13:20,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 602c6b >2014-01-30 07:13:20,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27c6b5b2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4bf68836}, log id: 602c6b >2014-01-30 07:13:20,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3e0757d1 >2014-01-30 07:13:21,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3e0757d1 >2014-01-30 07:13:21,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 644d05e2 >2014-01-30 07:13:21,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 644d05e2 >2014-01-30 07:13:26,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4cac06bd >2014-01-30 07:13:26,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4cac06bd >2014-01-30 07:13:26,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 282209ca >2014-01-30 07:13:27,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f628fa26, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24fcbf24}, log id: 282209ca >2014-01-30 07:13:27,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1bac78af >2014-01-30 07:13:27,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1bac78af >2014-01-30 07:13:27,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 75529850 >2014-01-30 07:13:28,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75529850 >2014-01-30 07:13:33,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e53521b >2014-01-30 07:13:33,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2e53521b >2014-01-30 07:13:33,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41e35a49 >2014-01-30 07:13:33,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea8ee9f9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9393f1fb}, log id: 41e35a49 >2014-01-30 07:13:33,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4cfb3ea6 >2014-01-30 07:13:34,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4cfb3ea6 >2014-01-30 07:13:34,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 28d8a8ab >2014-01-30 07:13:34,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28d8a8ab >2014-01-30 07:13:39,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31b60914 >2014-01-30 07:13:40,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 31b60914 >2014-01-30 07:13:40,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 45e78b4a >2014-01-30 07:13:40,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2db0d541, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99cb6092}, log id: 45e78b4a >2014-01-30 07:13:40,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 54bb3d1 >2014-01-30 07:13:40,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 54bb3d1 >2014-01-30 07:13:40,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 60987321 >2014-01-30 07:13:41,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60987321 >2014-01-30 07:13:46,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b7d0bad >2014-01-30 07:13:46,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4b7d0bad >2014-01-30 07:13:46,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 134e1f1f >2014-01-30 07:13:46,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d104e3d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3861ac64}, log id: 134e1f1f >2014-01-30 07:13:47,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: c95d0da >2014-01-30 07:13:47,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: c95d0da >2014-01-30 07:13:47,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1844c2d9 >2014-01-30 07:13:47,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1844c2d9 >2014-01-30 07:13:51,073 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) [79e57d6f] No up server in cluster >2014-01-30 07:13:51,073 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:13:51,076 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) [79e57d6f] No up server in cluster >2014-01-30 07:13:51,076 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:13:51,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 1c124654 >2014-01-30 07:13:51,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 1c124654 >2014-01-30 07:13:51,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4c43ebb >2014-01-30 07:13:51,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterTasksListVDSCommand, return: [], log id: 4c43ebb >2014-01-30 07:13:52,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 184333ed >2014-01-30 07:13:53,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 184333ed >2014-01-30 07:13:53,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b49b41 >2014-01-30 07:13:53,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f84c873, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47e6528}, log id: 3b49b41 >2014-01-30 07:13:53,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 19019c11 >2014-01-30 07:13:54,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 19019c11 >2014-01-30 07:13:54,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 330a7112 >2014-01-30 07:13:54,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 330a7112 >2014-01-30 07:13:59,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46194bd0 >2014-01-30 07:13:59,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 46194bd0 >2014-01-30 07:13:59,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2aff5728 >2014-01-30 07:14:00,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f5153d8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c361a00b}, log id: 2aff5728 >2014-01-30 07:14:00,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2bd1d9ba >2014-01-30 07:14:00,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2bd1d9ba >2014-01-30 07:14:00,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 797de001 >2014-01-30 07:14:00,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 797de001 >2014-01-30 07:14:05,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71310700 >2014-01-30 07:14:06,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 71310700 >2014-01-30 07:14:06,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f9c503a >2014-01-30 07:14:06,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee484e63, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32b96a7a}, log id: f9c503a >2014-01-30 07:14:06,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4920736 >2014-01-30 07:14:07,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4920736 >2014-01-30 07:14:07,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5b9d03c1 >2014-01-30 07:14:07,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b9d03c1 >2014-01-30 07:14:12,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ec1516d >2014-01-30 07:14:12,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1ec1516d >2014-01-30 07:14:12,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2763ab18 >2014-01-30 07:14:13,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56929e43, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d48add92}, log id: 2763ab18 >2014-01-30 07:14:13,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1fac9b57 >2014-01-30 07:14:13,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1fac9b57 >2014-01-30 07:14:13,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4baf23cd >2014-01-30 07:14:13,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4baf23cd >2014-01-30 07:14:18,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ce298c3 >2014-01-30 07:14:19,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5ce298c3 >2014-01-30 07:14:19,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e3db4c0 >2014-01-30 07:14:19,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b81951c6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31e135c3}, log id: 6e3db4c0 >2014-01-30 07:14:19,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7799a1c4 >2014-01-30 07:14:20,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7799a1c4 >2014-01-30 07:14:20,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6aa0a208 >2014-01-30 07:14:20,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6aa0a208 >2014-01-30 07:14:25,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72cc1fc7 >2014-01-30 07:14:26,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 72cc1fc7 >2014-01-30 07:14:26,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53364db3 >2014-01-30 07:14:26,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9254ad77, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83178270}, log id: 53364db3 >2014-01-30 07:14:26,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 90f1463 >2014-01-30 07:14:26,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 90f1463 >2014-01-30 07:14:26,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 712c2f4a >2014-01-30 07:14:27,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 712c2f4a >2014-01-30 07:14:32,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77358fae >2014-01-30 07:14:32,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 77358fae >2014-01-30 07:14:32,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 263ea234 >2014-01-30 07:14:32,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61ca6956, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef51b7a7}, log id: 263ea234 >2014-01-30 07:14:32,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 74935922 >2014-01-30 07:14:33,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 74935922 >2014-01-30 07:14:33,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6d07b85b >2014-01-30 07:14:33,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d07b85b >2014-01-30 07:14:38,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 758bec62 >2014-01-30 07:14:39,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 758bec62 >2014-01-30 07:14:39,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58554fc5 >2014-01-30 07:14:39,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6af3f1db, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5cacc68}, log id: 58554fc5 >2014-01-30 07:14:39,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1f5ea61a >2014-01-30 07:14:39,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1f5ea61a >2014-01-30 07:14:39,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1af380a9 >2014-01-30 07:14:40,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1af380a9 >2014-01-30 07:14:45,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b3ddee >2014-01-30 07:14:45,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b3ddee >2014-01-30 07:14:45,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 758d9eaa >2014-01-30 07:14:45,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ce9f5a4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76abd80b}, log id: 758d9eaa >2014-01-30 07:14:45,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2f8ef501 >2014-01-30 07:14:46,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2f8ef501 >2014-01-30 07:14:46,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 199a577a >2014-01-30 07:14:46,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 199a577a >2014-01-30 07:14:51,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50620086 >2014-01-30 07:14:51,902 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-23) [2517ed6c] No up server in cluster >2014-01-30 07:14:51,902 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:14:51,906 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-23) [2517ed6c] No up server in cluster >2014-01-30 07:14:51,906 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:14:51,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f5a4f24 >2014-01-30 07:14:52,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 50620086 >2014-01-30 07:14:52,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6df5df7e >2014-01-30 07:14:52,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 2f5a4f24 >2014-01-30 07:14:52,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 4eeb8beb >2014-01-30 07:14:52,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eef46769, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8050c7f}, log id: 6df5df7e >2014-01-30 07:14:52,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3214618f >2014-01-30 07:14:52,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterTasksListVDSCommand, return: [], log id: 4eeb8beb >2014-01-30 07:14:52,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3214618f >2014-01-30 07:14:52,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4edb28a3 >2014-01-30 07:14:53,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4edb28a3 >2014-01-30 07:14:58,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e5e435f >2014-01-30 07:14:58,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2e5e435f >2014-01-30 07:14:58,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c509ad7 >2014-01-30 07:14:59,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18450981, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e98536b1}, log id: 4c509ad7 >2014-01-30 07:14:59,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1a334303 >2014-01-30 07:14:59,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1a334303 >2014-01-30 07:14:59,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 59cfbc2 >2014-01-30 07:14:59,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59cfbc2 >2014-01-30 07:15:04,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3dcd7619 >2014-01-30 07:15:05,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3dcd7619 >2014-01-30 07:15:05,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f752fc7 >2014-01-30 07:15:05,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3199ef83, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcb0a2bd}, log id: 1f752fc7 >2014-01-30 07:15:05,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6dcd0928 >2014-01-30 07:15:06,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6dcd0928 >2014-01-30 07:15:06,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1711b1f0 >2014-01-30 07:15:06,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1711b1f0 >2014-01-30 07:15:11,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51e2e1e8 >2014-01-30 07:15:11,519 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-48) [4e07496f] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 07:15:11,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 51e2e1e8 >2014-01-30 07:15:11,860 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-48) [4e07496f] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 07:15:11,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58a66476 >2014-01-30 07:15:12,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f314a6ea, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6cc86526}, log id: 58a66476 >2014-01-30 07:15:12,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 4b9cf3c4 >2014-01-30 07:15:12,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3e413037 >2014-01-30 07:15:12,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6b79d64e, log id: 4b9cf3c4 >2014-01-30 07:15:12,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: be4d202 >2014-01-30 07:15:12,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3e413037 >2014-01-30 07:15:12,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 63e3f7e5 >2014-01-30 07:15:12,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2be90e80, log id: be4d202 >2014-01-30 07:15:12,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63e3f7e5 >2014-01-30 07:15:17,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c3352bc >2014-01-30 07:15:18,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c3352bc >2014-01-30 07:15:18,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36deac5f >2014-01-30 07:15:18,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0553c40, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef75a2da}, log id: 36deac5f >2014-01-30 07:15:18,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4a6d1413 >2014-01-30 07:15:19,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4a6d1413 >2014-01-30 07:15:19,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4bbb0a66 >2014-01-30 07:15:19,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4bbb0a66 >2014-01-30 07:15:24,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 508a3036 >2014-01-30 07:15:24,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 508a3036 >2014-01-30 07:15:24,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e070e0d >2014-01-30 07:15:25,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e234d0e6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa7d5276}, log id: 5e070e0d >2014-01-30 07:15:25,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ab5447a >2014-01-30 07:15:25,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3ab5447a >2014-01-30 07:15:25,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4a7626db >2014-01-30 07:15:26,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a7626db >2014-01-30 07:15:31,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d2a8f76 >2014-01-30 07:15:31,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1d2a8f76 >2014-01-30 07:15:31,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76a1f773 >2014-01-30 07:15:31,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63923f29, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1ccbcd9}, log id: 76a1f773 >2014-01-30 07:15:31,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2fb8fa97 >2014-01-30 07:15:32,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2fb8fa97 >2014-01-30 07:15:32,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2319e4c2 >2014-01-30 07:15:32,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2319e4c2 >2014-01-30 07:15:37,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 671aee6d >2014-01-30 07:15:38,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 671aee6d >2014-01-30 07:15:38,185 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40f1e4fc >2014-01-30 07:15:38,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5cf39137, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96236eaf}, log id: 40f1e4fc >2014-01-30 07:15:38,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6fb89050 >2014-01-30 07:15:38,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6fb89050 >2014-01-30 07:15:38,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7194effd >2014-01-30 07:15:39,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7194effd >2014-01-30 07:15:44,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2936a8d0 >2014-01-30 07:15:44,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2936a8d0 >2014-01-30 07:15:44,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30418661 >2014-01-30 07:15:45,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71f5e3d3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce6edb77}, log id: 30418661 >2014-01-30 07:15:45,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 61bb5c99 >2014-01-30 07:15:45,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 61bb5c99 >2014-01-30 07:15:45,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1f2aa973 >2014-01-30 07:15:45,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1f2aa973 >2014-01-30 07:15:50,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e8af9ae >2014-01-30 07:15:51,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1e8af9ae >2014-01-30 07:15:51,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 586b36be >2014-01-30 07:15:51,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9991353f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0397612}, log id: 586b36be >2014-01-30 07:15:51,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 439c74b2 >2014-01-30 07:15:52,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 439c74b2 >2014-01-30 07:15:52,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7c45e802 >2014-01-30 07:15:52,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c45e802 >2014-01-30 07:15:52,691 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] No up server in cluster >2014-01-30 07:15:52,691 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:15:52,694 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] No up server in cluster >2014-01-30 07:15:52,694 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:15:52,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 5bc6ada1 >2014-01-30 07:15:53,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 5bc6ada1 >2014-01-30 07:15:53,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3be5ee01 >2014-01-30 07:15:53,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterTasksListVDSCommand, return: [], log id: 3be5ee01 >2014-01-30 07:15:57,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6257c09c >2014-01-30 07:15:57,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6257c09c >2014-01-30 07:15:57,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54e4dfa3 >2014-01-30 07:15:58,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e85bc969, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29d96117}, log id: 54e4dfa3 >2014-01-30 07:15:58,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 585a2d1a >2014-01-30 07:15:58,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 585a2d1a >2014-01-30 07:15:58,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d95b7ef >2014-01-30 07:15:58,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d95b7ef >2014-01-30 07:16:03,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26e202db >2014-01-30 07:16:04,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 26e202db >2014-01-30 07:16:04,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 252904c >2014-01-30 07:16:04,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eff2cc1c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd2e1fc8}, log id: 252904c >2014-01-30 07:16:04,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 131e1f6c >2014-01-30 07:16:05,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 131e1f6c >2014-01-30 07:16:05,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 317cd02d >2014-01-30 07:16:05,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 317cd02d >2014-01-30 07:16:10,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ff0984c >2014-01-30 07:16:11,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4ff0984c >2014-01-30 07:16:11,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 575fe4b5 >2014-01-30 07:16:11,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b929195f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a9524a9}, log id: 575fe4b5 >2014-01-30 07:16:11,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 61012f88 >2014-01-30 07:16:11,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 61012f88 >2014-01-30 07:16:11,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3453e17e >2014-01-30 07:16:12,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3453e17e >2014-01-30 07:16:17,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2cda6c51 >2014-01-30 07:16:17,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2cda6c51 >2014-01-30 07:16:17,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e678d85 >2014-01-30 07:16:17,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94cb68c6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a7bb263}, log id: 1e678d85 >2014-01-30 07:16:17,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 363272b6 >2014-01-30 07:16:18,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 363272b6 >2014-01-30 07:16:18,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 307bbeb1 >2014-01-30 07:16:18,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 307bbeb1 >2014-01-30 07:16:23,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1db3841f >2014-01-30 07:16:24,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1db3841f >2014-01-30 07:16:24,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 142aeae7 >2014-01-30 07:16:24,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68ff01d0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5c10e06}, log id: 142aeae7 >2014-01-30 07:16:24,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4a0354b4 >2014-01-30 07:16:24,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4a0354b4 >2014-01-30 07:16:24,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4d139a5 >2014-01-30 07:16:25,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4d139a5 >2014-01-30 07:16:30,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c9ef06 >2014-01-30 07:16:30,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2c9ef06 >2014-01-30 07:16:30,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23a3c064 >2014-01-30 07:16:31,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90cd4ceb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16422a6b}, log id: 23a3c064 >2014-01-30 07:16:31,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5114c2d8 >2014-01-30 07:16:31,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5114c2d8 >2014-01-30 07:16:31,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65ea3dfe >2014-01-30 07:16:31,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65ea3dfe >2014-01-30 07:16:36,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b2d0438 >2014-01-30 07:16:37,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1b2d0438 >2014-01-30 07:16:37,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f849712 >2014-01-30 07:16:37,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a59b50b9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84b5a927}, log id: 7f849712 >2014-01-30 07:16:37,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e672267 >2014-01-30 07:16:38,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4e672267 >2014-01-30 07:16:38,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5623fa87 >2014-01-30 07:16:38,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5623fa87 >2014-01-30 07:16:43,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22d8d0ba >2014-01-30 07:16:43,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 22d8d0ba >2014-01-30 07:16:43,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f65eec1 >2014-01-30 07:16:44,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed3b9bfe, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29fdac09}, log id: 1f65eec1 >2014-01-30 07:16:44,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 74033ae4 >2014-01-30 07:16:44,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 74033ae4 >2014-01-30 07:16:44,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1758ce5 >2014-01-30 07:16:44,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1758ce5 >2014-01-30 07:16:49,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 62f5ccf7 >2014-01-30 07:16:50,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 62f5ccf7 >2014-01-30 07:16:50,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c3026c >2014-01-30 07:16:50,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4a3967c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6759545}, log id: 6c3026c >2014-01-30 07:16:50,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 152ea86a >2014-01-30 07:16:51,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 152ea86a >2014-01-30 07:16:51,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 575ed4f2 >2014-01-30 07:16:51,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 575ed4f2 >2014-01-30 07:16:53,523 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-99) [63a33dd9] No up server in cluster >2014-01-30 07:16:53,523 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:16:53,526 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-99) [63a33dd9] No up server in cluster >2014-01-30 07:16:53,526 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:16:53,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f3f8d61 >2014-01-30 07:16:54,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 7f3f8d61 >2014-01-30 07:16:54,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3fa20a1b >2014-01-30 07:16:54,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterTasksListVDSCommand, return: [], log id: 3fa20a1b >2014-01-30 07:16:56,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b02d5d5 >2014-01-30 07:16:56,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: b02d5d5 >2014-01-30 07:16:56,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c815e55 >2014-01-30 07:16:57,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1fb2bf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd9dcd61}, log id: 5c815e55 >2014-01-30 07:16:57,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 202015c6 >2014-01-30 07:16:57,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 202015c6 >2014-01-30 07:16:57,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7bf68fa0 >2014-01-30 07:16:57,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7bf68fa0 >2014-01-30 07:17:02,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 489a11ef >2014-01-30 07:17:03,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 489a11ef >2014-01-30 07:17:03,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27bef74a >2014-01-30 07:17:03,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4535d5d6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8038ba40}, log id: 27bef74a >2014-01-30 07:17:03,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 14d663d1 >2014-01-30 07:17:04,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 14d663d1 >2014-01-30 07:17:04,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4a694e0c >2014-01-30 07:17:04,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a694e0c >2014-01-30 07:17:09,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49372d2f >2014-01-30 07:17:09,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 49372d2f >2014-01-30 07:17:10,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b6de4ac >2014-01-30 07:17:10,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a64e6d6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5af21ec6}, log id: 4b6de4ac >2014-01-30 07:17:10,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7455ed68 >2014-01-30 07:17:10,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7455ed68 >2014-01-30 07:17:10,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 68851486 >2014-01-30 07:17:11,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68851486 >2014-01-30 07:17:16,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1efa571f >2014-01-30 07:17:16,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1efa571f >2014-01-30 07:17:16,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51618683 >2014-01-30 07:17:16,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49f3dbf9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a5c794c}, log id: 51618683 >2014-01-30 07:17:16,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5f2e1a7e >2014-01-30 07:17:17,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5f2e1a7e >2014-01-30 07:17:17,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6cbd5c01 >2014-01-30 07:17:17,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6cbd5c01 >2014-01-30 07:17:22,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ac5d93d >2014-01-30 07:17:23,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: ac5d93d >2014-01-30 07:17:23,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c776ed0 >2014-01-30 07:17:23,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df59670, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36f93d51}, log id: 7c776ed0 >2014-01-30 07:17:23,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2ccde1fc >2014-01-30 07:17:23,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2ccde1fc >2014-01-30 07:17:23,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 40e40f9c >2014-01-30 07:17:24,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40e40f9c >2014-01-30 07:17:29,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b0b617a >2014-01-30 07:17:29,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1b0b617a >2014-01-30 07:17:29,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 238cc58d >2014-01-30 07:17:29,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@940324fb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b623304}, log id: 238cc58d >2014-01-30 07:17:29,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 52114983 >2014-01-30 07:17:30,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 52114983 >2014-01-30 07:17:30,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3dfa63a7 >2014-01-30 07:17:30,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3dfa63a7 >2014-01-30 07:17:35,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71e16240 >2014-01-30 07:17:36,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 71e16240 >2014-01-30 07:17:36,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 258d6f97 >2014-01-30 07:17:36,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@640fc475, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19281f7e}, log id: 258d6f97 >2014-01-30 07:17:36,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 75694a5c >2014-01-30 07:17:37,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 75694a5c >2014-01-30 07:17:37,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 70dbe5f5 >2014-01-30 07:17:37,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70dbe5f5 >2014-01-30 07:17:42,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74990b64 >2014-01-30 07:17:42,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 74990b64 >2014-01-30 07:17:42,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 45e7f762 >2014-01-30 07:17:43,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e1270dc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f7d986b}, log id: 45e7f762 >2014-01-30 07:17:43,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 72ebac38 >2014-01-30 07:17:43,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 72ebac38 >2014-01-30 07:17:43,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6de08c6 >2014-01-30 07:17:43,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6de08c6 >2014-01-30 07:17:48,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b1e8a29 >2014-01-30 07:17:49,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4b1e8a29 >2014-01-30 07:17:49,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ac68c0a >2014-01-30 07:17:49,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a678ba5a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e67f647c}, log id: 6ac68c0a >2014-01-30 07:17:49,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 20bb1b4c >2014-01-30 07:17:50,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 20bb1b4c >2014-01-30 07:17:50,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 16a27376 >2014-01-30 07:17:50,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16a27376 >2014-01-30 07:17:54,366 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) [23554188] No up server in cluster >2014-01-30 07:17:54,367 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) [23554188] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:17:54,370 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) [23554188] No up server in cluster >2014-01-30 07:17:54,370 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) [23554188] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:17:54,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 53749265 >2014-01-30 07:17:54,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 53749265 >2014-01-30 07:17:54,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 579831e3 >2014-01-30 07:17:55,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterTasksListVDSCommand, return: [], log id: 579831e3 >2014-01-30 07:17:55,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43d285f4 >2014-01-30 07:17:55,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43d285f4 >2014-01-30 07:17:55,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e7b813e >2014-01-30 07:17:56,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a206a007, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2de90997}, log id: 4e7b813e >2014-01-30 07:17:56,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 36a72874 >2014-01-30 07:17:56,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 36a72874 >2014-01-30 07:17:56,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 53b3b715 >2014-01-30 07:17:56,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53b3b715 >2014-01-30 07:18:01,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7460f2f5 >2014-01-30 07:18:02,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7460f2f5 >2014-01-30 07:18:02,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15a52dbd >2014-01-30 07:18:02,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45ed178f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed40d5ae}, log id: 15a52dbd >2014-01-30 07:18:02,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 124debdc >2014-01-30 07:18:03,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 124debdc >2014-01-30 07:18:03,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 309ce03d >2014-01-30 07:18:03,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 309ce03d >2014-01-30 07:18:08,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f2da9f0 >2014-01-30 07:18:09,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2f2da9f0 >2014-01-30 07:18:09,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 635a3c05 >2014-01-30 07:18:09,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8d598c9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94a1558d}, log id: 635a3c05 >2014-01-30 07:18:09,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1c3588a8 >2014-01-30 07:18:09,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1c3588a8 >2014-01-30 07:18:09,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 103aa51e >2014-01-30 07:18:10,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 103aa51e >2014-01-30 07:18:15,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51b9fe63 >2014-01-30 07:18:15,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 51b9fe63 >2014-01-30 07:18:15,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31b578e1 >2014-01-30 07:18:15,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80203e63, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ef0dd76}, log id: 31b578e1 >2014-01-30 07:18:15,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 276b9c46 >2014-01-30 07:18:16,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 276b9c46 >2014-01-30 07:18:16,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5fea6a87 >2014-01-30 07:18:16,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fea6a87 >2014-01-30 07:18:21,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ce7b2d8 >2014-01-30 07:18:22,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6ce7b2d8 >2014-01-30 07:18:22,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 692774d >2014-01-30 07:18:22,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd34dce3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd1c58b3}, log id: 692774d >2014-01-30 07:18:22,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 74666d67 >2014-01-30 07:18:23,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 74666d67 >2014-01-30 07:18:23,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 937186a >2014-01-30 07:18:23,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 937186a >2014-01-30 07:18:28,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8e9af20 >2014-01-30 07:18:28,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 8e9af20 >2014-01-30 07:18:28,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ec80da6 >2014-01-30 07:18:29,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b503b31, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@483e393a}, log id: 4ec80da6 >2014-01-30 07:18:29,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 469adf65 >2014-01-30 07:18:29,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 469adf65 >2014-01-30 07:18:29,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 45a09702 >2014-01-30 07:18:29,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 45a09702 >2014-01-30 07:18:34,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 865cbfa >2014-01-30 07:18:35,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 865cbfa >2014-01-30 07:18:35,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1089ea49 >2014-01-30 07:18:35,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8695f96d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d2d5cd6}, log id: 1089ea49 >2014-01-30 07:18:35,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ee41c28 >2014-01-30 07:18:36,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: ee41c28 >2014-01-30 07:18:36,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3a983ef9 >2014-01-30 07:18:36,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a983ef9 >2014-01-30 07:18:41,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d4a53dd >2014-01-30 07:18:42,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3d4a53dd >2014-01-30 07:18:42,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74b2b792 >2014-01-30 07:18:42,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1462ea32, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9b316cd}, log id: 74b2b792 >2014-01-30 07:18:42,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: a37abd4 >2014-01-30 07:18:42,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: a37abd4 >2014-01-30 07:18:42,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 49c9d577 >2014-01-30 07:18:43,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49c9d577 >2014-01-30 07:18:48,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b7f31d7 >2014-01-30 07:18:48,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6b7f31d7 >2014-01-30 07:18:48,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4014093d >2014-01-30 07:18:48,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd377872, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@627bd726}, log id: 4014093d >2014-01-30 07:18:48,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6c1281fc >2014-01-30 07:18:49,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6c1281fc >2014-01-30 07:18:49,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 170380a4 >2014-01-30 07:18:49,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 170380a4 >2014-01-30 07:18:54,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17dc28a1 >2014-01-30 07:18:55,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 17dc28a1 >2014-01-30 07:18:55,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 235a59d2 >2014-01-30 07:18:55,200 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-68) No up server in cluster >2014-01-30 07:18:55,200 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-68) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:18:55,203 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-68) No up server in cluster >2014-01-30 07:18:55,204 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-68) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:18:55,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 2d3f003a >2014-01-30 07:18:55,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c06c1d83, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e9e056f}, log id: 235a59d2 >2014-01-30 07:18:55,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4d01380a >2014-01-30 07:18:55,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 2d3f003a >2014-01-30 07:18:55,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 225f01a6 >2014-01-30 07:18:55,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4d01380a >2014-01-30 07:18:55,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b127558 >2014-01-30 07:18:55,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterTasksListVDSCommand, return: [], log id: 225f01a6 >2014-01-30 07:18:56,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b127558 >2014-01-30 07:19:01,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d0633ea >2014-01-30 07:19:01,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: d0633ea >2014-01-30 07:19:01,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52b1b348 >2014-01-30 07:19:01,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dba85a36, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46f2403}, log id: 52b1b348 >2014-01-30 07:19:01,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c89e4bf >2014-01-30 07:19:02,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5c89e4bf >2014-01-30 07:19:02,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 49c7017b >2014-01-30 07:19:02,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49c7017b >2014-01-30 07:19:07,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 360ba094 >2014-01-30 07:19:08,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 360ba094 >2014-01-30 07:19:08,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f17af27 >2014-01-30 07:19:08,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de3dfd95, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1438348e}, log id: 1f17af27 >2014-01-30 07:19:08,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 12797f65 >2014-01-30 07:19:08,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 12797f65 >2014-01-30 07:19:08,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1581861b >2014-01-30 07:19:09,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1581861b >2014-01-30 07:19:14,187 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13219587 >2014-01-30 07:19:14,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 13219587 >2014-01-30 07:19:14,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21adb9c2 >2014-01-30 07:19:14,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@957a5f6d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ee84626}, log id: 21adb9c2 >2014-01-30 07:19:14,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 26be2c5f >2014-01-30 07:19:15,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 26be2c5f >2014-01-30 07:19:15,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 75e9f9cc >2014-01-30 07:19:15,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75e9f9cc >2014-01-30 07:19:20,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6974a61b >2014-01-30 07:19:21,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6974a61b >2014-01-30 07:19:21,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b7111e2 >2014-01-30 07:19:21,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2370dc5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b9149fe}, log id: 6b7111e2 >2014-01-30 07:19:21,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6c4ff444 >2014-01-30 07:19:22,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6c4ff444 >2014-01-30 07:19:22,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 61e77ea6 >2014-01-30 07:19:22,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61e77ea6 >2014-01-30 07:19:27,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ae84fc2 >2014-01-30 07:19:27,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1ae84fc2 >2014-01-30 07:19:27,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f336309 >2014-01-30 07:19:28,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68aa4012, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5cfd04c}, log id: 6f336309 >2014-01-30 07:19:28,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1532c97a >2014-01-30 07:19:28,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1532c97a >2014-01-30 07:19:28,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 71b80e10 >2014-01-30 07:19:28,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71b80e10 >2014-01-30 07:19:33,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3188a900 >2014-01-30 07:19:34,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3188a900 >2014-01-30 07:19:34,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a8d5dd5 >2014-01-30 07:19:34,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9797beee, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@403b232a}, log id: 1a8d5dd5 >2014-01-30 07:19:34,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3f3b9ab >2014-01-30 07:19:35,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3f3b9ab >2014-01-30 07:19:35,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 71732b73 >2014-01-30 07:19:35,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71732b73 >2014-01-30 07:19:40,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2fa34e93 >2014-01-30 07:19:40,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2fa34e93 >2014-01-30 07:19:40,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d8a6527 >2014-01-30 07:19:41,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11aecbef, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f898d35}, log id: 3d8a6527 >2014-01-30 07:19:41,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1ff108cf >2014-01-30 07:19:41,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1ff108cf >2014-01-30 07:19:41,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5b19e659 >2014-01-30 07:19:41,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b19e659 >2014-01-30 07:19:47,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d5baa74 >2014-01-30 07:19:47,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7d5baa74 >2014-01-30 07:19:47,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4bf0034a >2014-01-30 07:19:47,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9c3cfdb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9751c4bc}, log id: 4bf0034a >2014-01-30 07:19:47,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 17a7967 >2014-01-30 07:19:48,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 17a7967 >2014-01-30 07:19:48,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 594a3941 >2014-01-30 07:19:48,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 594a3941 >2014-01-30 07:19:53,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7982dca6 >2014-01-30 07:19:54,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7982dca6 >2014-01-30 07:19:54,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33fe2b98 >2014-01-30 07:19:54,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73afbcb1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d1de1f6}, log id: 33fe2b98 >2014-01-30 07:19:54,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7524a472 >2014-01-30 07:19:54,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7524a472 >2014-01-30 07:19:54,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 767e2a21 >2014-01-30 07:19:55,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 767e2a21 >2014-01-30 07:19:55,964 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-47) [2296644d] No up server in cluster >2014-01-30 07:19:55,964 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-47) [2296644d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:19:55,966 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-47) [2296644d] No up server in cluster >2014-01-30 07:19:55,967 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-47) [2296644d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:19:55,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37f91d79 >2014-01-30 07:19:56,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 37f91d79 >2014-01-30 07:19:56,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 19747f9 >2014-01-30 07:19:56,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterTasksListVDSCommand, return: [], log id: 19747f9 >2014-01-30 07:20:00,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 670ed2f5 >2014-01-30 07:20:00,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 670ed2f5 >2014-01-30 07:20:00,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53bbd303 >2014-01-30 07:20:00,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2f59909, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12837d89}, log id: 53bbd303 >2014-01-30 07:20:01,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1b745363 >2014-01-30 07:20:01,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1b745363 >2014-01-30 07:20:01,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d084bf0 >2014-01-30 07:20:01,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d084bf0 >2014-01-30 07:20:06,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7658297a >2014-01-30 07:20:07,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7658297a >2014-01-30 07:20:07,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e306cc1 >2014-01-30 07:20:07,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0545a1c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@260b41e9}, log id: e306cc1 >2014-01-30 07:20:07,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 68e0f8e3 >2014-01-30 07:20:08,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 68e0f8e3 >2014-01-30 07:20:08,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 47c773d3 >2014-01-30 07:20:08,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47c773d3 >2014-01-30 07:20:12,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 383be9e7 >2014-01-30 07:20:13,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4e14651b, log id: 383be9e7 >2014-01-30 07:20:13,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1cf9f7a9 >2014-01-30 07:20:13,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6e00f358, log id: 1cf9f7a9 >2014-01-30 07:20:13,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f5e55 >2014-01-30 07:20:13,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7f5e55 >2014-01-30 07:20:13,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5008e618 >2014-01-30 07:20:14,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@732839f4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c43d3879}, log id: 5008e618 >2014-01-30 07:20:14,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 52abd4fb >2014-01-30 07:20:14,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 52abd4fb >2014-01-30 07:20:14,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7814aa70 >2014-01-30 07:20:14,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7814aa70 >2014-01-30 07:20:19,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e4ab0df >2014-01-30 07:20:20,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7e4ab0df >2014-01-30 07:20:20,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76b4580e >2014-01-30 07:20:20,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@441da3f3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@386cf368}, log id: 76b4580e >2014-01-30 07:20:20,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d04804c >2014-01-30 07:20:21,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7d04804c >2014-01-30 07:20:21,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 25e6281b >2014-01-30 07:20:21,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25e6281b >2014-01-30 07:20:26,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6affc40b >2014-01-30 07:20:26,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6affc40b >2014-01-30 07:20:26,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 368a2880 >2014-01-30 07:20:27,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e07819f6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec1757a1}, log id: 368a2880 >2014-01-30 07:20:27,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7142b288 >2014-01-30 07:20:27,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7142b288 >2014-01-30 07:20:27,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7dbb18d8 >2014-01-30 07:20:27,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7dbb18d8 >2014-01-30 07:20:32,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53db0a47 >2014-01-30 07:20:33,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 53db0a47 >2014-01-30 07:20:33,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d3b3317 >2014-01-30 07:20:33,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e03ada68, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@848a58d4}, log id: 4d3b3317 >2014-01-30 07:20:33,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6eca4f36 >2014-01-30 07:20:34,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6eca4f36 >2014-01-30 07:20:34,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 164baaef >2014-01-30 07:20:34,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 164baaef >2014-01-30 07:20:39,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b725b51 >2014-01-30 07:20:40,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2b725b51 >2014-01-30 07:20:40,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 438b4817 >2014-01-30 07:20:40,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fc75e36, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50651398}, log id: 438b4817 >2014-01-30 07:20:40,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 66006850 >2014-01-30 07:20:40,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 66006850 >2014-01-30 07:20:40,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 41939930 >2014-01-30 07:20:41,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41939930 >2014-01-30 07:20:46,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 626bdcbd >2014-01-30 07:20:46,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 626bdcbd >2014-01-30 07:20:46,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64ebcd71 >2014-01-30 07:20:46,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e675a0a7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f81655c3}, log id: 64ebcd71 >2014-01-30 07:20:46,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1b8e1a09 >2014-01-30 07:20:47,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1b8e1a09 >2014-01-30 07:20:47,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5111fbba >2014-01-30 07:20:47,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5111fbba >2014-01-30 07:20:52,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ea22641 >2014-01-30 07:20:53,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2ea22641 >2014-01-30 07:20:53,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 75ef7a9c >2014-01-30 07:20:53,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@375a8b5c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11e46ad6}, log id: 75ef7a9c >2014-01-30 07:20:53,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 23b0ae20 >2014-01-30 07:20:53,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 23b0ae20 >2014-01-30 07:20:53,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: cb8dd14 >2014-01-30 07:20:54,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: cb8dd14 >2014-01-30 07:20:56,789 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-93) [24fadd7c] No up server in cluster >2014-01-30 07:20:56,789 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:20:56,791 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-93) [24fadd7c] No up server in cluster >2014-01-30 07:20:56,791 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:20:56,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a81ee0c >2014-01-30 07:20:57,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 6a81ee0c >2014-01-30 07:20:57,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 2719fff8 >2014-01-30 07:20:57,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterTasksListVDSCommand, return: [], log id: 2719fff8 >2014-01-30 07:20:59,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 582a7585 >2014-01-30 07:20:59,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 582a7585 >2014-01-30 07:20:59,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76818a03 >2014-01-30 07:20:59,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1b8775c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@798655d}, log id: 76818a03 >2014-01-30 07:21:00,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6b29e754 >2014-01-30 07:21:00,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6b29e754 >2014-01-30 07:21:00,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5322a9f >2014-01-30 07:21:00,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5322a9f >2014-01-30 07:21:05,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 202a8d23 >2014-01-30 07:21:06,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 202a8d23 >2014-01-30 07:21:06,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f30819f >2014-01-30 07:21:06,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@289a3477, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1cb3c79}, log id: 4f30819f >2014-01-30 07:21:06,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5674c93f >2014-01-30 07:21:07,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5674c93f >2014-01-30 07:21:07,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5bbc1b9b >2014-01-30 07:21:07,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5bbc1b9b >2014-01-30 07:21:12,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53726fb3 >2014-01-30 07:21:12,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 53726fb3 >2014-01-30 07:21:12,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 644f5c8a >2014-01-30 07:21:13,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0331c2f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42719298}, log id: 644f5c8a >2014-01-30 07:21:13,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3095a19c >2014-01-30 07:21:13,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3095a19c >2014-01-30 07:21:13,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b453daf >2014-01-30 07:21:13,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b453daf >2014-01-30 07:21:18,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 55d9c0f4 >2014-01-30 07:21:19,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 55d9c0f4 >2014-01-30 07:21:19,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29b14ab1 >2014-01-30 07:21:19,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5ced784, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9372e58f}, log id: 29b14ab1 >2014-01-30 07:21:19,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6b75dc8f >2014-01-30 07:21:20,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6b75dc8f >2014-01-30 07:21:20,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5e8f33a5 >2014-01-30 07:21:20,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5e8f33a5 >2014-01-30 07:21:25,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 337150a2 >2014-01-30 07:21:25,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 337150a2 >2014-01-30 07:21:25,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 292bbfd4 >2014-01-30 07:21:26,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@855ece56, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@433f2fce}, log id: 292bbfd4 >2014-01-30 07:21:26,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 721e220d >2014-01-30 07:21:26,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 721e220d >2014-01-30 07:21:26,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4362b230 >2014-01-30 07:21:27,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4362b230 >2014-01-30 07:21:32,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ca4df61 >2014-01-30 07:21:32,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5ca4df61 >2014-01-30 07:21:32,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f73fc4a >2014-01-30 07:21:32,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@acaddb8a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b777f639}, log id: 3f73fc4a >2014-01-30 07:21:32,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1baa27a6 >2014-01-30 07:21:33,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1baa27a6 >2014-01-30 07:21:33,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6a35f599 >2014-01-30 07:21:33,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a35f599 >2014-01-30 07:21:38,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7013e792 >2014-01-30 07:21:39,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7013e792 >2014-01-30 07:21:39,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66ae3bb1 >2014-01-30 07:21:39,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6b9b54, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e6028c1}, log id: 66ae3bb1 >2014-01-30 07:21:39,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 38066b78 >2014-01-30 07:21:39,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 38066b78 >2014-01-30 07:21:39,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 48d9f51d >2014-01-30 07:21:40,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 48d9f51d >2014-01-30 07:21:45,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56e97238 >2014-01-30 07:21:45,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 56e97238 >2014-01-30 07:21:45,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f2a3ebb >2014-01-30 07:21:45,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@894c0653, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9458e1d}, log id: f2a3ebb >2014-01-30 07:21:46,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 76de527d >2014-01-30 07:21:46,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 76de527d >2014-01-30 07:21:46,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7ea5eb35 >2014-01-30 07:21:46,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7ea5eb35 >2014-01-30 07:21:51,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 75af5793 >2014-01-30 07:21:52,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 75af5793 >2014-01-30 07:21:52,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fd943aa >2014-01-30 07:21:52,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a485aed4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ca8454f}, log id: 3fd943aa >2014-01-30 07:21:52,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 25a76c69 >2014-01-30 07:21:53,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 25a76c69 >2014-01-30 07:21:53,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7add83 >2014-01-30 07:21:53,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7add83 >2014-01-30 07:21:57,620 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-44) [221fed7d] No up server in cluster >2014-01-30 07:21:57,621 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-44) [221fed7d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:21:57,624 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-44) [221fed7d] No up server in cluster >2014-01-30 07:21:57,624 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-44) [221fed7d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:21:57,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 73b616ab >2014-01-30 07:21:58,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 73b616ab >2014-01-30 07:21:58,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3f75d7b0 >2014-01-30 07:21:58,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59a5362d >2014-01-30 07:21:58,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterTasksListVDSCommand, return: [], log id: 3f75d7b0 >2014-01-30 07:21:58,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 59a5362d >2014-01-30 07:21:58,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22d47dc2 >2014-01-30 07:21:59,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10d3b75d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@116875a1}, log id: 22d47dc2 >2014-01-30 07:21:59,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2fc447d5 >2014-01-30 07:21:59,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2fc447d5 >2014-01-30 07:21:59,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ca9f2ca >2014-01-30 07:21:59,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ca9f2ca >2014-01-30 07:22:04,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f4bef73 >2014-01-30 07:22:05,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4f4bef73 >2014-01-30 07:22:05,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72bda3 >2014-01-30 07:22:05,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dab5afb4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72cb6b12}, log id: 72bda3 >2014-01-30 07:22:05,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2ec00e6f >2014-01-30 07:22:06,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2ec00e6f >2014-01-30 07:22:06,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 75e33c5a >2014-01-30 07:22:06,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75e33c5a >2014-01-30 07:22:11,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46f0dc53 >2014-01-30 07:22:11,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 46f0dc53 >2014-01-30 07:22:11,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65bba975 >2014-01-30 07:22:12,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@780b9286, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b00d5b2}, log id: 65bba975 >2014-01-30 07:22:12,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 68e16296 >2014-01-30 07:22:12,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 68e16296 >2014-01-30 07:22:12,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77d55ea0 >2014-01-30 07:22:12,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 77d55ea0 >2014-01-30 07:22:18,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4545c532 >2014-01-30 07:22:18,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4545c532 >2014-01-30 07:22:18,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 577303be >2014-01-30 07:22:18,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@893c479, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f9f8329}, log id: 577303be >2014-01-30 07:22:18,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 807a0a4 >2014-01-30 07:22:19,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 807a0a4 >2014-01-30 07:22:19,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 355f42b7 >2014-01-30 07:22:19,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 355f42b7 >2014-01-30 07:22:24,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10843299 >2014-01-30 07:22:25,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 10843299 >2014-01-30 07:22:25,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13cd94c6 >2014-01-30 07:22:25,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a9ac1e6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@704cc863}, log id: 13cd94c6 >2014-01-30 07:22:25,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 335da68e >2014-01-30 07:22:25,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 335da68e >2014-01-30 07:22:25,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 177cbbb8 >2014-01-30 07:22:26,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 177cbbb8 >2014-01-30 07:22:31,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 685a6a2c >2014-01-30 07:22:31,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 685a6a2c >2014-01-30 07:22:31,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e6587a6 >2014-01-30 07:22:31,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a50e6506, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd04b11a}, log id: 1e6587a6 >2014-01-30 07:22:31,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: a11adba >2014-01-30 07:22:32,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: a11adba >2014-01-30 07:22:32,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 68d20be3 >2014-01-30 07:22:32,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68d20be3 >2014-01-30 07:22:37,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 585607b6 >2014-01-30 07:22:38,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 585607b6 >2014-01-30 07:22:38,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67deb7e5 >2014-01-30 07:22:38,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a0427e3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41a1814d}, log id: 67deb7e5 >2014-01-30 07:22:38,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 18ca53b5 >2014-01-30 07:22:38,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 18ca53b5 >2014-01-30 07:22:38,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4015b6f7 >2014-01-30 07:22:39,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4015b6f7 >2014-01-30 07:22:44,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 287ee6b4 >2014-01-30 07:22:44,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 287ee6b4 >2014-01-30 07:22:44,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6eff6947 >2014-01-30 07:22:44,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9c8c013, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a20954f}, log id: 6eff6947 >2014-01-30 07:22:44,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 8e8c144 >2014-01-30 07:22:45,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 8e8c144 >2014-01-30 07:22:45,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6dedac07 >2014-01-30 07:22:45,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6dedac07 >2014-01-30 07:22:50,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10e91ddb >2014-01-30 07:22:51,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 10e91ddb >2014-01-30 07:22:51,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f06eff5 >2014-01-30 07:22:51,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b069443, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f20a44b7}, log id: 2f06eff5 >2014-01-30 07:22:51,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5be066b3 >2014-01-30 07:22:52,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5be066b3 >2014-01-30 07:22:52,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 79a609eb >2014-01-30 07:22:52,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79a609eb >2014-01-30 07:22:57,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ec9f >2014-01-30 07:22:57,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5ec9f >2014-01-30 07:22:57,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4865aa4f >2014-01-30 07:22:58,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@778fa58, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68608665}, log id: 4865aa4f >2014-01-30 07:22:58,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 13c0bbd3 >2014-01-30 07:22:58,430 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-84) [2ccca513] No up server in cluster >2014-01-30 07:22:58,430 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-84) [2ccca513] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:22:58,433 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-84) [2ccca513] No up server in cluster >2014-01-30 07:22:58,433 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-84) [2ccca513] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:22:58,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: e3bfa0a >2014-01-30 07:22:58,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 13c0bbd3 >2014-01-30 07:22:58,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 19a85cca >2014-01-30 07:22:58,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19a85cca >2014-01-30 07:22:58,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: e3bfa0a >2014-01-30 07:22:58,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 23db71fe >2014-01-30 07:22:59,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterTasksListVDSCommand, return: [], log id: 23db71fe >2014-01-30 07:23:03,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41f6a0a2 >2014-01-30 07:23:04,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 41f6a0a2 >2014-01-30 07:23:04,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7294347c >2014-01-30 07:23:04,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcaeb021, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80aa60d}, log id: 7294347c >2014-01-30 07:23:04,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7cf1bde6 >2014-01-30 07:23:05,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7cf1bde6 >2014-01-30 07:23:05,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 28ab9e8 >2014-01-30 07:23:05,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 28ab9e8 >2014-01-30 07:23:10,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 268cc4bd >2014-01-30 07:23:11,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 268cc4bd >2014-01-30 07:23:11,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8597c7e >2014-01-30 07:23:11,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7249ac, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0ab41b8}, log id: 8597c7e >2014-01-30 07:23:11,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ce3258 >2014-01-30 07:23:11,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6ce3258 >2014-01-30 07:23:11,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 78b98193 >2014-01-30 07:23:12,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78b98193 >2014-01-30 07:23:17,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72e12402 >2014-01-30 07:23:17,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 72e12402 >2014-01-30 07:23:17,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27961b16 >2014-01-30 07:23:18,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@161749ad, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0d132be}, log id: 27961b16 >2014-01-30 07:23:18,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ae131d >2014-01-30 07:23:18,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: ae131d >2014-01-30 07:23:18,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6a8770da >2014-01-30 07:23:18,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a8770da >2014-01-30 07:23:23,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f10d776 >2014-01-30 07:23:24,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7f10d776 >2014-01-30 07:23:24,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2522ecf5 >2014-01-30 07:23:24,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fffec365, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfd30f5f}, log id: 2522ecf5 >2014-01-30 07:23:24,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 23137d37 >2014-01-30 07:23:25,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 23137d37 >2014-01-30 07:23:25,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 43d6961a >2014-01-30 07:23:25,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43d6961a >2014-01-30 07:23:30,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 776a2e91 >2014-01-30 07:23:30,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 776a2e91 >2014-01-30 07:23:30,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a4cea8a >2014-01-30 07:23:31,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@731600fa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f197715}, log id: 4a4cea8a >2014-01-30 07:23:31,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 68bff8d2 >2014-01-30 07:23:31,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 68bff8d2 >2014-01-30 07:23:31,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6811d1f9 >2014-01-30 07:23:31,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6811d1f9 >2014-01-30 07:23:36,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f5803b6 >2014-01-30 07:23:37,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f5803b6 >2014-01-30 07:23:37,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5be14f57 >2014-01-30 07:23:37,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@990c2cfb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f08394c6}, log id: 5be14f57 >2014-01-30 07:23:37,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4ebc3a02 >2014-01-30 07:23:38,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4ebc3a02 >2014-01-30 07:23:38,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2c2ca0da >2014-01-30 07:23:38,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c2ca0da >2014-01-30 07:23:43,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46716d07 >2014-01-30 07:23:43,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 46716d07 >2014-01-30 07:23:43,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30cd0d17 >2014-01-30 07:23:44,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c41927, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e11157f}, log id: 30cd0d17 >2014-01-30 07:23:44,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2523d5fb >2014-01-30 07:23:44,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2523d5fb >2014-01-30 07:23:44,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 538afcef >2014-01-30 07:23:44,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 538afcef >2014-01-30 07:23:49,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ed96592 >2014-01-30 07:23:50,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1ed96592 >2014-01-30 07:23:50,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 305de58e >2014-01-30 07:23:50,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6ba0b9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd360e6f}, log id: 305de58e >2014-01-30 07:23:50,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4d6928fd >2014-01-30 07:23:51,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4d6928fd >2014-01-30 07:23:51,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3e6cefa9 >2014-01-30 07:23:51,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e6cefa9 >2014-01-30 07:23:56,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36054f26 >2014-01-30 07:23:57,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 36054f26 >2014-01-30 07:23:57,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f8580cd >2014-01-30 07:23:57,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff1516f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff543798}, log id: f8580cd >2014-01-30 07:23:57,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1ba4938e >2014-01-30 07:23:57,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1ba4938e >2014-01-30 07:23:57,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 159570da >2014-01-30 07:23:58,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 159570da >2014-01-30 07:23:59,242 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-61) [62f75f5f] No up server in cluster >2014-01-30 07:23:59,242 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-61) [62f75f5f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:23:59,245 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-61) [62f75f5f] No up server in cluster >2014-01-30 07:23:59,245 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-61) [62f75f5f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:23:59,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 2b37602f >2014-01-30 07:23:59,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 2b37602f >2014-01-30 07:23:59,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65ac5dfe >2014-01-30 07:24:00,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterTasksListVDSCommand, return: [], log id: 65ac5dfe >2014-01-30 07:24:03,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: fe4dbe4 >2014-01-30 07:24:03,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: fe4dbe4 >2014-01-30 07:24:03,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 357196d >2014-01-30 07:24:03,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cb0b27d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ccd5a50}, log id: 357196d >2014-01-30 07:24:04,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 49cdc05 >2014-01-30 07:24:04,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 49cdc05 >2014-01-30 07:24:04,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2121ff2f >2014-01-30 07:24:04,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2121ff2f >2014-01-30 07:24:09,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72682261 >2014-01-30 07:24:10,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 72682261 >2014-01-30 07:24:10,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1508daad >2014-01-30 07:24:10,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7860e477, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbdc34a5}, log id: 1508daad >2014-01-30 07:24:10,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6de1d686 >2014-01-30 07:24:11,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6de1d686 >2014-01-30 07:24:11,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 32d460cb >2014-01-30 07:24:11,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32d460cb >2014-01-30 07:24:16,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6820315e >2014-01-30 07:24:16,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6820315e >2014-01-30 07:24:16,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24f6ad70 >2014-01-30 07:24:17,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@372996fd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52884b08}, log id: 24f6ad70 >2014-01-30 07:24:17,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 51bef1f8 >2014-01-30 07:24:17,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 51bef1f8 >2014-01-30 07:24:17,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 8d6658d >2014-01-30 07:24:17,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8d6658d >2014-01-30 07:24:22,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78d76aab >2014-01-30 07:24:23,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 78d76aab >2014-01-30 07:24:23,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c45f10a >2014-01-30 07:24:23,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3eef4ad3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a9566df}, log id: 1c45f10a >2014-01-30 07:24:23,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 52b4dafc >2014-01-30 07:24:24,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 52b4dafc >2014-01-30 07:24:24,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6d2b310b >2014-01-30 07:24:24,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d2b310b >2014-01-30 07:24:29,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 154ed7ca >2014-01-30 07:24:29,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 154ed7ca >2014-01-30 07:24:29,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5153211b >2014-01-30 07:24:30,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8400b81b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1a72bb6}, log id: 5153211b >2014-01-30 07:24:30,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 496e9eb8 >2014-01-30 07:24:30,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 496e9eb8 >2014-01-30 07:24:30,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: e272abb >2014-01-30 07:24:30,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e272abb >2014-01-30 07:24:35,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6bdab84 >2014-01-30 07:24:36,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6bdab84 >2014-01-30 07:24:36,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ba0411 >2014-01-30 07:24:36,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1156f6e2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@412895ca}, log id: 6ba0411 >2014-01-30 07:24:36,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1023d0cd >2014-01-30 07:24:37,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1023d0cd >2014-01-30 07:24:37,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ef018bd >2014-01-30 07:24:37,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ef018bd >2014-01-30 07:24:42,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 326a4609 >2014-01-30 07:24:42,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 326a4609 >2014-01-30 07:24:42,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44d8417d >2014-01-30 07:24:43,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12ff0f1e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94793b5b}, log id: 44d8417d >2014-01-30 07:24:43,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 13aa3479 >2014-01-30 07:24:43,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 13aa3479 >2014-01-30 07:24:43,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1e91bea >2014-01-30 07:24:44,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e91bea >2014-01-30 07:24:49,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16fc5efb >2014-01-30 07:24:49,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 16fc5efb >2014-01-30 07:24:49,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72fc5e1c >2014-01-30 07:24:49,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc8f5f89, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bee823c5}, log id: 72fc5e1c >2014-01-30 07:24:49,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ce29e25 >2014-01-30 07:24:50,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: ce29e25 >2014-01-30 07:24:50,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 796156f0 >2014-01-30 07:24:50,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 796156f0 >2014-01-30 07:24:55,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46ceaa0 >2014-01-30 07:24:56,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 46ceaa0 >2014-01-30 07:24:56,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65158d88 >2014-01-30 07:24:56,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95832ce5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d2a2bfa}, log id: 65158d88 >2014-01-30 07:24:56,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2d8bc70 >2014-01-30 07:24:56,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2d8bc70 >2014-01-30 07:24:56,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 88b92aa >2014-01-30 07:24:57,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 88b92aa >2014-01-30 07:25:00,084 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] No up server in cluster >2014-01-30 07:25:00,084 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:25:00,087 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] No up server in cluster >2014-01-30 07:25:00,088 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:25:00,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 850a6f6 >2014-01-30 07:25:00,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 850a6f6 >2014-01-30 07:25:00,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 558c2214 >2014-01-30 07:25:00,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterTasksListVDSCommand, return: [], log id: 558c2214 >2014-01-30 07:25:02,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74639775 >2014-01-30 07:25:02,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 74639775 >2014-01-30 07:25:02,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a048262 >2014-01-30 07:25:02,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b50498af, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63435769}, log id: 4a048262 >2014-01-30 07:25:02,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3f9a868 >2014-01-30 07:25:03,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3f9a868 >2014-01-30 07:25:03,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 612eec24 >2014-01-30 07:25:03,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 612eec24 >2014-01-30 07:25:08,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26afe4e3 >2014-01-30 07:25:09,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 26afe4e3 >2014-01-30 07:25:09,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44ab6f6f >2014-01-30 07:25:09,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80f0492d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7bae530b}, log id: 44ab6f6f >2014-01-30 07:25:09,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 962ee9a >2014-01-30 07:25:09,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 962ee9a >2014-01-30 07:25:09,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4eebd3a7 >2014-01-30 07:25:10,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4eebd3a7 >2014-01-30 07:25:13,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 775a1575 >2014-01-30 07:25:13,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@5d4bee6e, log id: 775a1575 >2014-01-30 07:25:13,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2412a79c >2014-01-30 07:25:13,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@98a713b, log id: 2412a79c >2014-01-30 07:25:15,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d444aaf >2014-01-30 07:25:15,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6d444aaf >2014-01-30 07:25:15,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f003d30 >2014-01-30 07:25:16,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@daa31970, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b39f475}, log id: 4f003d30 >2014-01-30 07:25:16,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 19982f2b >2014-01-30 07:25:16,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 19982f2b >2014-01-30 07:25:16,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d1b5293 >2014-01-30 07:25:16,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d1b5293 >2014-01-30 07:25:21,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7109531c >2014-01-30 07:25:22,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7109531c >2014-01-30 07:25:22,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29d14ca5 >2014-01-30 07:25:22,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abdd30a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@594e15e7}, log id: 29d14ca5 >2014-01-30 07:25:22,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ea22c86 >2014-01-30 07:25:23,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6ea22c86 >2014-01-30 07:25:23,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3977385a >2014-01-30 07:25:23,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3977385a >2014-01-30 07:25:28,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ebc5a03 >2014-01-30 07:25:28,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1ebc5a03 >2014-01-30 07:25:28,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35bd6a05 >2014-01-30 07:25:29,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@197c8bb2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc802dd}, log id: 35bd6a05 >2014-01-30 07:25:29,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 14085c91 >2014-01-30 07:25:29,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 14085c91 >2014-01-30 07:25:29,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6e938d0e >2014-01-30 07:25:29,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6e938d0e >2014-01-30 07:25:34,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 789ef5f2 >2014-01-30 07:25:35,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 789ef5f2 >2014-01-30 07:25:35,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 239bcb88 >2014-01-30 07:25:35,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca173e81, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfd09d0c}, log id: 239bcb88 >2014-01-30 07:25:35,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1bce9bbf >2014-01-30 07:25:36,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1bce9bbf >2014-01-30 07:25:36,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 40ed8ae5 >2014-01-30 07:25:36,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40ed8ae5 >2014-01-30 07:25:41,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 165754 >2014-01-30 07:25:41,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 165754 >2014-01-30 07:25:41,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d4519d3 >2014-01-30 07:25:42,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9821be84, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1f2d959}, log id: 3d4519d3 >2014-01-30 07:25:42,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77ed9e76 >2014-01-30 07:25:42,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 77ed9e76 >2014-01-30 07:25:42,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e19dc38 >2014-01-30 07:25:42,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e19dc38 >2014-01-30 07:25:47,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a1d01f3 >2014-01-30 07:25:48,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a1d01f3 >2014-01-30 07:25:48,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46f75e00 >2014-01-30 07:25:48,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9192c37c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41a96ae9}, log id: 46f75e00 >2014-01-30 07:25:48,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: fc73d16 >2014-01-30 07:25:49,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: fc73d16 >2014-01-30 07:25:49,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ee467cf >2014-01-30 07:25:49,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: ee467cf >2014-01-30 07:25:54,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44615c93 >2014-01-30 07:25:55,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 44615c93 >2014-01-30 07:25:55,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7eb5012b >2014-01-30 07:25:55,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d58dc99, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68e73290}, log id: 7eb5012b >2014-01-30 07:25:55,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: a8777e3 >2014-01-30 07:25:55,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: a8777e3 >2014-01-30 07:25:55,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5de8b6ee >2014-01-30 07:25:56,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5de8b6ee >2014-01-30 07:26:00,930 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] No up server in cluster >2014-01-30 07:26:00,930 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:26:00,933 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] No up server in cluster >2014-01-30 07:26:00,933 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:26:00,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 749e8d84 >2014-01-30 07:26:01,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c8e5c81 >2014-01-30 07:26:01,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 749e8d84 >2014-01-30 07:26:01,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 6adb1dda >2014-01-30 07:26:01,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4c8e5c81 >2014-01-30 07:26:01,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 645b2029 >2014-01-30 07:26:01,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterTasksListVDSCommand, return: [], log id: 6adb1dda >2014-01-30 07:26:01,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d0c83f7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66b1215a}, log id: 645b2029 >2014-01-30 07:26:01,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5318cb01 >2014-01-30 07:26:02,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5318cb01 >2014-01-30 07:26:02,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1e3f0ab7 >2014-01-30 07:26:02,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e3f0ab7 >2014-01-30 07:26:07,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b11c2eb >2014-01-30 07:26:08,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7b11c2eb >2014-01-30 07:26:08,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b99ee62 >2014-01-30 07:26:08,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffab76e9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d0deef9}, log id: b99ee62 >2014-01-30 07:26:08,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1971307f >2014-01-30 07:26:08,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1971307f >2014-01-30 07:26:08,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1df1672a >2014-01-30 07:26:09,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1df1672a >2014-01-30 07:26:14,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a70dc15 >2014-01-30 07:26:14,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1a70dc15 >2014-01-30 07:26:14,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e680431 >2014-01-30 07:26:14,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@828e0e6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@760fd007}, log id: 5e680431 >2014-01-30 07:26:15,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 46c42c7f >2014-01-30 07:26:15,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 46c42c7f >2014-01-30 07:26:15,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 26346d4b >2014-01-30 07:26:15,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26346d4b >2014-01-30 07:26:20,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4cbc2691 >2014-01-30 07:26:21,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4cbc2691 >2014-01-30 07:26:21,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 323a5be0 >2014-01-30 07:26:21,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92b13b3f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83748c97}, log id: 323a5be0 >2014-01-30 07:26:21,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 32bd74d0 >2014-01-30 07:26:22,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 32bd74d0 >2014-01-30 07:26:22,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 54722e43 >2014-01-30 07:26:22,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54722e43 >2014-01-30 07:26:27,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13a8b1ad >2014-01-30 07:26:27,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 13a8b1ad >2014-01-30 07:26:27,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ae843a5 >2014-01-30 07:26:28,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e423625, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a88d1b47}, log id: 4ae843a5 >2014-01-30 07:26:28,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 73f877dd >2014-01-30 07:26:28,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 73f877dd >2014-01-30 07:26:28,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 394db79b >2014-01-30 07:26:28,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 394db79b >2014-01-30 07:26:33,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b5d1a8e >2014-01-30 07:26:34,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7b5d1a8e >2014-01-30 07:26:34,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c931582 >2014-01-30 07:26:34,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@683c5f40, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2cfeaed}, log id: 2c931582 >2014-01-30 07:26:34,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1e4789c9 >2014-01-30 07:26:35,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1e4789c9 >2014-01-30 07:26:35,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 62f856b1 >2014-01-30 07:26:35,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62f856b1 >2014-01-30 07:26:40,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37cbd1e7 >2014-01-30 07:26:40,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 37cbd1e7 >2014-01-30 07:26:40,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27b5826d >2014-01-30 07:26:41,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a22d7cb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b504eb17}, log id: 27b5826d >2014-01-30 07:26:41,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 39a37a84 >2014-01-30 07:26:41,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 39a37a84 >2014-01-30 07:26:41,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7285c0ff >2014-01-30 07:26:41,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7285c0ff >2014-01-30 07:26:46,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ab68f7c >2014-01-30 07:26:47,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1ab68f7c >2014-01-30 07:26:47,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1dd960b7 >2014-01-30 07:26:47,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c089020d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d43fe588}, log id: 1dd960b7 >2014-01-30 07:26:47,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 22799f8c >2014-01-30 07:26:48,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 22799f8c >2014-01-30 07:26:48,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 26101ecb >2014-01-30 07:26:48,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26101ecb >2014-01-30 07:26:53,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 771e331f >2014-01-30 07:26:54,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 771e331f >2014-01-30 07:26:54,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52479f2a >2014-01-30 07:26:54,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b538d049, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2b7d58d}, log id: 52479f2a >2014-01-30 07:26:54,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4b06238b >2014-01-30 07:26:54,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4b06238b >2014-01-30 07:26:54,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5192b43d >2014-01-30 07:26:55,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5192b43d >2014-01-30 07:27:00,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c8621e1 >2014-01-30 07:27:00,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4c8621e1 >2014-01-30 07:27:00,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3730a201 >2014-01-30 07:27:00,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dbecdd61, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aadab905}, log id: 3730a201 >2014-01-30 07:27:00,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d876baa >2014-01-30 07:27:01,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7d876baa >2014-01-30 07:27:01,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2f3d55cb >2014-01-30 07:27:01,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f3d55cb >2014-01-30 07:27:01,740 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-15) [13272f75] No up server in cluster >2014-01-30 07:27:01,740 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-15) [13272f75] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:27:01,743 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-15) [13272f75] No up server in cluster >2014-01-30 07:27:01,743 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-15) [13272f75] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:27:01,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: ff257aa >2014-01-30 07:27:02,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: ff257aa >2014-01-30 07:27:02,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4beda209 >2014-01-30 07:27:02,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterTasksListVDSCommand, return: [], log id: 4beda209 >2014-01-30 07:27:06,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f6c500f >2014-01-30 07:27:07,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7f6c500f >2014-01-30 07:27:07,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68bf6990 >2014-01-30 07:27:07,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9eaf01d4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e4265ad}, log id: 68bf6990 >2014-01-30 07:27:07,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 699aaf7 >2014-01-30 07:27:07,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 699aaf7 >2014-01-30 07:27:07,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6939aefa >2014-01-30 07:27:08,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6939aefa >2014-01-30 07:27:13,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e666729 >2014-01-30 07:27:13,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e666729 >2014-01-30 07:27:13,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33367c40 >2014-01-30 07:27:13,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d32c6657, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74629810}, log id: 33367c40 >2014-01-30 07:27:13,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 688d0d8c >2014-01-30 07:27:14,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 688d0d8c >2014-01-30 07:27:14,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 53965105 >2014-01-30 07:27:14,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 53965105 >2014-01-30 07:27:19,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 62692c9 >2014-01-30 07:27:20,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 62692c9 >2014-01-30 07:27:20,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c65ea0b >2014-01-30 07:27:20,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6ebf542, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5694d957}, log id: 7c65ea0b >2014-01-30 07:27:20,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7c4b82af >2014-01-30 07:27:21,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7c4b82af >2014-01-30 07:27:21,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 160a830f >2014-01-30 07:27:21,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 160a830f >2014-01-30 07:27:26,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46efde7a >2014-01-30 07:27:26,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 46efde7a >2014-01-30 07:27:26,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b9f9bd9 >2014-01-30 07:27:27,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31dd0ffd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6d9e02f}, log id: 1b9f9bd9 >2014-01-30 07:27:27,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6aae32ba >2014-01-30 07:27:27,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6aae32ba >2014-01-30 07:27:27,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 610ca5c0 >2014-01-30 07:27:27,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 610ca5c0 >2014-01-30 07:27:32,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2bdb2daf >2014-01-30 07:27:33,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2bdb2daf >2014-01-30 07:27:33,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44c18e49 >2014-01-30 07:27:33,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32437166, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48f87f0e}, log id: 44c18e49 >2014-01-30 07:27:33,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 34634ef0 >2014-01-30 07:27:34,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 34634ef0 >2014-01-30 07:27:34,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 21d1f293 >2014-01-30 07:27:34,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21d1f293 >2014-01-30 07:27:39,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e771084 >2014-01-30 07:27:39,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6e771084 >2014-01-30 07:27:39,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37c95da6 >2014-01-30 07:27:40,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ede85ec, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7bd9d3a}, log id: 37c95da6 >2014-01-30 07:27:40,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 385193ab >2014-01-30 07:27:40,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 385193ab >2014-01-30 07:27:40,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 33e0f7ad >2014-01-30 07:27:40,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33e0f7ad >2014-01-30 07:27:45,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 55c7d4dc >2014-01-30 07:27:46,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 55c7d4dc >2014-01-30 07:27:46,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ec36d85 >2014-01-30 07:27:46,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aba00229, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab167daa}, log id: 6ec36d85 >2014-01-30 07:27:46,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2db0144c >2014-01-30 07:27:47,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2db0144c >2014-01-30 07:27:47,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 14c585c >2014-01-30 07:27:47,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14c585c >2014-01-30 07:27:52,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44430000 >2014-01-30 07:27:53,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 44430000 >2014-01-30 07:27:53,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ec3b69c >2014-01-30 07:27:53,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be339986, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58b4edc1}, log id: 4ec3b69c >2014-01-30 07:27:53,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 290bfc04 >2014-01-30 07:27:53,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 290bfc04 >2014-01-30 07:27:53,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 593f8e3a >2014-01-30 07:27:54,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 593f8e3a >2014-01-30 07:27:59,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b5fa038 >2014-01-30 07:27:59,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1b5fa038 >2014-01-30 07:27:59,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16781d66 >2014-01-30 07:27:59,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8dfe139e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25107c90}, log id: 16781d66 >2014-01-30 07:27:59,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: e6680f2 >2014-01-30 07:28:00,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: e6680f2 >2014-01-30 07:28:00,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1556507c >2014-01-30 07:28:00,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1556507c >2014-01-30 07:28:02,588 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) [68161e48] No up server in cluster >2014-01-30 07:28:02,588 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) [68161e48] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:28:02,591 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) [68161e48] No up server in cluster >2014-01-30 07:28:02,591 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) [68161e48] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:28:02,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 1de7e8b2 >2014-01-30 07:28:03,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 1de7e8b2 >2014-01-30 07:28:03,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 1f135a97 >2014-01-30 07:28:03,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterTasksListVDSCommand, return: [], log id: 1f135a97 >2014-01-30 07:28:05,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ff51b >2014-01-30 07:28:06,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2ff51b >2014-01-30 07:28:06,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 549b1a01 >2014-01-30 07:28:06,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ade1a669, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e89bf1d4}, log id: 549b1a01 >2014-01-30 07:28:06,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 73967214 >2014-01-30 07:28:07,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 73967214 >2014-01-30 07:28:07,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ae29ab7 >2014-01-30 07:28:07,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ae29ab7 >2014-01-30 07:28:12,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b9b2959 >2014-01-30 07:28:12,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b9b2959 >2014-01-30 07:28:12,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5259e2af >2014-01-30 07:28:13,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5dec3526, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83f5cc6c}, log id: 5259e2af >2014-01-30 07:28:13,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e6e8395 >2014-01-30 07:28:13,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4e6e8395 >2014-01-30 07:28:13,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 290f2661 >2014-01-30 07:28:13,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 290f2661 >2014-01-30 07:28:18,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fece63b >2014-01-30 07:28:19,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3fece63b >2014-01-30 07:28:19,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 104604e4 >2014-01-30 07:28:19,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b1c7c95, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63d7095e}, log id: 104604e4 >2014-01-30 07:28:19,709 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: de4b352 >2014-01-30 07:28:20,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: de4b352 >2014-01-30 07:28:20,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5021c0a6 >2014-01-30 07:28:20,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5021c0a6 >2014-01-30 07:28:25,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 526759dc >2014-01-30 07:28:25,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 526759dc >2014-01-30 07:28:25,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2124cb08 >2014-01-30 07:28:26,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc2eb9a0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c27bdb2d}, log id: 2124cb08 >2014-01-30 07:28:26,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 478d6699 >2014-01-30 07:28:26,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 478d6699 >2014-01-30 07:28:26,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 14b4a4a9 >2014-01-30 07:28:26,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 14b4a4a9 >2014-01-30 07:28:31,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 709a95a1 >2014-01-30 07:28:32,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 709a95a1 >2014-01-30 07:28:32,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32e20ae3 >2014-01-30 07:28:32,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d779e6a8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c3c90b9}, log id: 32e20ae3 >2014-01-30 07:28:32,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 49f150b4 >2014-01-30 07:28:33,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 49f150b4 >2014-01-30 07:28:33,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 37ccfd37 >2014-01-30 07:28:33,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37ccfd37 >2014-01-30 07:28:38,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c49dd46 >2014-01-30 07:28:39,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7c49dd46 >2014-01-30 07:28:39,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4258fd05 >2014-01-30 07:28:39,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6455b92, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@644755e4}, log id: 4258fd05 >2014-01-30 07:28:39,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4489f45a >2014-01-30 07:28:39,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4489f45a >2014-01-30 07:28:39,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6507fb4c >2014-01-30 07:28:40,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6507fb4c >2014-01-30 07:28:45,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59b833c >2014-01-30 07:28:45,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 59b833c >2014-01-30 07:28:45,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f5b3f6c >2014-01-30 07:28:45,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@699ea3fa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@916841a1}, log id: 7f5b3f6c >2014-01-30 07:28:45,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3b90fb49 >2014-01-30 07:28:46,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3b90fb49 >2014-01-30 07:28:46,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4ff9d655 >2014-01-30 07:28:46,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ff9d655 >2014-01-30 07:28:51,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19ff30bb >2014-01-30 07:28:52,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 19ff30bb >2014-01-30 07:28:52,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: dc2f24d >2014-01-30 07:28:52,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@123ec9b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d70732d}, log id: dc2f24d >2014-01-30 07:28:52,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5269104d >2014-01-30 07:28:52,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5269104d >2014-01-30 07:28:52,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 773661b2 >2014-01-30 07:28:53,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 773661b2 >2014-01-30 07:28:58,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54b18228 >2014-01-30 07:28:58,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 54b18228 >2014-01-30 07:28:58,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f166416 >2014-01-30 07:28:59,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b5a37f3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d375606}, log id: 7f166416 >2014-01-30 07:28:59,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7e74d821 >2014-01-30 07:28:59,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7e74d821 >2014-01-30 07:28:59,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 829ae95 >2014-01-30 07:28:59,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 829ae95 >2014-01-30 07:29:03,420 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-93) [24fadd7c] No up server in cluster >2014-01-30 07:29:03,420 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:29:03,423 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-93) [24fadd7c] No up server in cluster >2014-01-30 07:29:03,423 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:29:03,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 3ec8a31a >2014-01-30 07:29:03,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 3ec8a31a >2014-01-30 07:29:03,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 377c996f >2014-01-30 07:29:04,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterTasksListVDSCommand, return: [], log id: 377c996f >2014-01-30 07:29:04,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3626fdf2 >2014-01-30 07:29:05,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3626fdf2 >2014-01-30 07:29:05,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32d8a6e0 >2014-01-30 07:29:05,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7cb2a446, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cb5ef84}, log id: 32d8a6e0 >2014-01-30 07:29:05,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 21ddfe60 >2014-01-30 07:29:06,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 21ddfe60 >2014-01-30 07:29:06,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: c69ee0d >2014-01-30 07:29:06,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: c69ee0d >2014-01-30 07:29:11,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b399280 >2014-01-30 07:29:11,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b399280 >2014-01-30 07:29:11,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 47c1a394 >2014-01-30 07:29:12,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1254acca, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25980dfb}, log id: 47c1a394 >2014-01-30 07:29:12,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 56173e21 >2014-01-30 07:29:12,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 56173e21 >2014-01-30 07:29:12,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 475c6690 >2014-01-30 07:29:12,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 475c6690 >2014-01-30 07:29:17,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4fbcf39f >2014-01-30 07:29:18,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4fbcf39f >2014-01-30 07:29:18,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25816d0f >2014-01-30 07:29:18,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3306b370, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b492cb0f}, log id: 25816d0f >2014-01-30 07:29:18,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 75716fdc >2014-01-30 07:29:19,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 75716fdc >2014-01-30 07:29:19,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 73940874 >2014-01-30 07:29:19,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73940874 >2014-01-30 07:29:24,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7140b473 >2014-01-30 07:29:24,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7140b473 >2014-01-30 07:29:24,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29e99dad >2014-01-30 07:29:25,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83b27980, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cd6d4da}, log id: 29e99dad >2014-01-30 07:29:25,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4ffbc7f2 >2014-01-30 07:29:25,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4ffbc7f2 >2014-01-30 07:29:25,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5da57cf5 >2014-01-30 07:29:26,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5da57cf5 >2014-01-30 07:29:31,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c6f4123 >2014-01-30 07:29:31,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3c6f4123 >2014-01-30 07:29:31,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1be3b615 >2014-01-30 07:29:31,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22a4c66b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35261ffc}, log id: 1be3b615 >2014-01-30 07:29:31,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 25db9b5c >2014-01-30 07:29:32,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 25db9b5c >2014-01-30 07:29:32,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3fcdd7c0 >2014-01-30 07:29:32,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3fcdd7c0 >2014-01-30 07:29:37,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: fd83868 >2014-01-30 07:29:38,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: fd83868 >2014-01-30 07:29:38,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44c29180 >2014-01-30 07:29:38,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b321f8b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@523e35f5}, log id: 44c29180 >2014-01-30 07:29:38,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 35e78f10 >2014-01-30 07:29:38,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 35e78f10 >2014-01-30 07:29:38,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1d84a150 >2014-01-30 07:29:39,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d84a150 >2014-01-30 07:29:44,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6011d457 >2014-01-30 07:29:44,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6011d457 >2014-01-30 07:29:44,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b1ef051 >2014-01-30 07:29:44,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f29e808, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a6adab0}, log id: 7b1ef051 >2014-01-30 07:29:44,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 46278a67 >2014-01-30 07:29:45,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 46278a67 >2014-01-30 07:29:45,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2fa49a61 >2014-01-30 07:29:45,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2fa49a61 >2014-01-30 07:29:50,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: dc3bf3b >2014-01-30 07:29:51,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: dc3bf3b >2014-01-30 07:29:51,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6fc32d15 >2014-01-30 07:29:51,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9aaf59d8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@523b79e4}, log id: 6fc32d15 >2014-01-30 07:29:51,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 443ae13d >2014-01-30 07:29:52,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 443ae13d >2014-01-30 07:29:52,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6178a0ae >2014-01-30 07:29:52,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6178a0ae >2014-01-30 07:29:57,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3160576f >2014-01-30 07:29:57,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3160576f >2014-01-30 07:29:57,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3940cef0 >2014-01-30 07:29:58,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ce8116e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ec2969a}, log id: 3940cef0 >2014-01-30 07:29:58,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 792b9d9e >2014-01-30 07:29:58,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 792b9d9e >2014-01-30 07:29:58,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4cc53b99 >2014-01-30 07:29:58,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4cc53b99 >2014-01-30 07:30:03,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 403b4389 >2014-01-30 07:30:04,259 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-27) [1194a119] No up server in cluster >2014-01-30 07:30:04,260 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-27) [1194a119] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:30:04,262 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-27) [1194a119] No up server in cluster >2014-01-30 07:30:04,262 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-27) [1194a119] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:30:04,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1dad2a00 >2014-01-30 07:30:04,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 403b4389 >2014-01-30 07:30:04,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20c4de22 >2014-01-30 07:30:04,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@704cfa91, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1fa88a1}, log id: 20c4de22 >2014-01-30 07:30:04,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2480d62a >2014-01-30 07:30:04,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 1dad2a00 >2014-01-30 07:30:04,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6c4780af >2014-01-30 07:30:05,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterTasksListVDSCommand, return: [], log id: 6c4780af >2014-01-30 07:30:05,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2480d62a >2014-01-30 07:30:05,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4db39fe9 >2014-01-30 07:30:05,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4db39fe9 >2014-01-30 07:30:10,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 75d30e99 >2014-01-30 07:30:10,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 75d30e99 >2014-01-30 07:30:10,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f9a4bfa >2014-01-30 07:30:11,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17e23634, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e14388d0}, log id: 7f9a4bfa >2014-01-30 07:30:11,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1cb530f6 >2014-01-30 07:30:11,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1cb530f6 >2014-01-30 07:30:11,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 49b0cea0 >2014-01-30 07:30:11,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49b0cea0 >2014-01-30 07:30:13,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: e99de5f >2014-01-30 07:30:14,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@29b0ca40, log id: e99de5f >2014-01-30 07:30:14,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 15ae4522 >2014-01-30 07:30:14,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@79e31367, log id: 15ae4522 >2014-01-30 07:30:16,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 128b2b50 >2014-01-30 07:30:17,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 128b2b50 >2014-01-30 07:30:17,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18c08a3c >2014-01-30 07:30:17,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e7124b2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc7039d9}, log id: 18c08a3c >2014-01-30 07:30:17,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2d987f2f >2014-01-30 07:30:18,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2d987f2f >2014-01-30 07:30:18,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2df3e924 >2014-01-30 07:30:18,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2df3e924 >2014-01-30 07:30:23,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20981b6f >2014-01-30 07:30:23,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 20981b6f >2014-01-30 07:30:23,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e3b54d4 >2014-01-30 07:30:24,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cf067bc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e8712e4}, log id: 4e3b54d4 >2014-01-30 07:30:24,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3b7542d0 >2014-01-30 07:30:24,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3b7542d0 >2014-01-30 07:30:24,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7092f944 >2014-01-30 07:30:25,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7092f944 >2014-01-30 07:30:30,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c4e553c >2014-01-30 07:30:30,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4c4e553c >2014-01-30 07:30:30,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c86e417 >2014-01-30 07:30:30,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8038f372, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f45ea30}, log id: 5c86e417 >2014-01-30 07:30:30,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4fb699c3 >2014-01-30 07:30:31,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4fb699c3 >2014-01-30 07:30:31,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7fac566e >2014-01-30 07:30:31,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7fac566e >2014-01-30 07:30:36,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 799ae28d >2014-01-30 07:30:37,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 799ae28d >2014-01-30 07:30:37,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e062827 >2014-01-30 07:30:37,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1322624, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba0eb63c}, log id: 1e062827 >2014-01-30 07:30:37,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 18d8ec14 >2014-01-30 07:30:37,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 18d8ec14 >2014-01-30 07:30:37,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7cf8d442 >2014-01-30 07:30:38,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7cf8d442 >2014-01-30 07:30:43,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c86d51e >2014-01-30 07:30:43,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5c86d51e >2014-01-30 07:30:43,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2391def3 >2014-01-30 07:30:43,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab5d6b1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3af6817}, log id: 2391def3 >2014-01-30 07:30:43,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 10b737f4 >2014-01-30 07:30:44,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 10b737f4 >2014-01-30 07:30:44,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 37eb65b8 >2014-01-30 07:30:44,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37eb65b8 >2014-01-30 07:30:49,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ed84b6e >2014-01-30 07:30:50,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4ed84b6e >2014-01-30 07:30:50,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 310b2d73 >2014-01-30 07:30:50,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4ff911f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78c0e631}, log id: 310b2d73 >2014-01-30 07:30:50,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1352f2df >2014-01-30 07:30:51,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1352f2df >2014-01-30 07:30:51,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6daa69cb >2014-01-30 07:30:51,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6daa69cb >2014-01-30 07:30:56,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20018a0 >2014-01-30 07:30:56,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 20018a0 >2014-01-30 07:30:56,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c807648 >2014-01-30 07:30:57,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67a4e17e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fddd806a}, log id: 2c807648 >2014-01-30 07:30:57,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5e1af421 >2014-01-30 07:30:57,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5e1af421 >2014-01-30 07:30:57,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 592d5676 >2014-01-30 07:30:57,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 592d5676 >2014-01-30 07:31:02,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f8abbc4 >2014-01-30 07:31:03,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f8abbc4 >2014-01-30 07:31:03,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f08fe10 >2014-01-30 07:31:03,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@624b0ccf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5df5c50e}, log id: 2f08fe10 >2014-01-30 07:31:03,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 47692268 >2014-01-30 07:31:04,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 47692268 >2014-01-30 07:31:04,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: b01f432 >2014-01-30 07:31:04,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: b01f432 >2014-01-30 07:31:05,111 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-54) [2214a5ea] No up server in cluster >2014-01-30 07:31:05,112 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:31:05,115 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-54) [2214a5ea] No up server in cluster >2014-01-30 07:31:05,115 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:31:05,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 4ec80fa0 >2014-01-30 07:31:05,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4ec80fa0 >2014-01-30 07:31:05,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6b6a0147 >2014-01-30 07:31:05,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterTasksListVDSCommand, return: [], log id: 6b6a0147 >2014-01-30 07:31:09,377 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4986fe65 >2014-01-30 07:31:09,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4986fe65 >2014-01-30 07:31:09,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5baa5571 >2014-01-30 07:31:10,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@626be23a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36ebce42}, log id: 5baa5571 >2014-01-30 07:31:10,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 43bdd06e >2014-01-30 07:31:10,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 43bdd06e >2014-01-30 07:31:10,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 766bf7a3 >2014-01-30 07:31:10,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 766bf7a3 >2014-01-30 07:31:15,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35bac6c >2014-01-30 07:31:16,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 35bac6c >2014-01-30 07:31:16,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d5ca97 >2014-01-30 07:31:16,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@825e847d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6195e5c}, log id: 3d5ca97 >2014-01-30 07:31:16,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6f4a3e57 >2014-01-30 07:31:17,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6f4a3e57 >2014-01-30 07:31:17,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6b0fbcfd >2014-01-30 07:31:17,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b0fbcfd >2014-01-30 07:31:22,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 268f19e1 >2014-01-30 07:31:23,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 268f19e1 >2014-01-30 07:31:23,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71297ca9 >2014-01-30 07:31:23,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49259fe4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c53eaa59}, log id: 71297ca9 >2014-01-30 07:31:23,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6d7f1a35 >2014-01-30 07:31:23,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6d7f1a35 >2014-01-30 07:31:23,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ef02ed6 >2014-01-30 07:31:24,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ef02ed6 >2014-01-30 07:31:29,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b03dd28 >2014-01-30 07:31:29,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6b03dd28 >2014-01-30 07:31:29,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c4d8642 >2014-01-30 07:31:29,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9692e149, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3b36a89}, log id: 4c4d8642 >2014-01-30 07:31:29,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 27e1e26a >2014-01-30 07:31:30,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 27e1e26a >2014-01-30 07:31:30,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7da9dd21 >2014-01-30 07:31:30,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7da9dd21 >2014-01-30 07:31:35,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64a3f4c >2014-01-30 07:31:36,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 64a3f4c >2014-01-30 07:31:36,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4961d4d6 >2014-01-30 07:31:36,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98020901, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b91dfb1e}, log id: 4961d4d6 >2014-01-30 07:31:36,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 8d4a23d >2014-01-30 07:31:36,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 8d4a23d >2014-01-30 07:31:36,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 435588cc >2014-01-30 07:31:37,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 435588cc >2014-01-30 07:31:42,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d4c4d92 >2014-01-30 07:31:42,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2d4c4d92 >2014-01-30 07:31:42,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c84b2f5 >2014-01-30 07:31:43,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f6e4c7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4b652b}, log id: 5c84b2f5 >2014-01-30 07:31:43,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1b36363f >2014-01-30 07:31:43,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1b36363f >2014-01-30 07:31:43,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6cdf29d2 >2014-01-30 07:31:43,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6cdf29d2 >2014-01-30 07:31:48,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3324d334 >2014-01-30 07:31:49,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3324d334 >2014-01-30 07:31:49,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c582f9d >2014-01-30 07:31:49,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d985da8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46c2d0e4}, log id: c582f9d >2014-01-30 07:31:49,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2088c453 >2014-01-30 07:31:50,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2088c453 >2014-01-30 07:31:50,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 19d51007 >2014-01-30 07:31:50,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19d51007 >2014-01-30 07:31:55,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68e62c7f >2014-01-30 07:31:55,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 68e62c7f >2014-01-30 07:31:55,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77002579 >2014-01-30 07:31:56,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3de5901b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@571d2e05}, log id: 77002579 >2014-01-30 07:31:56,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7e748d99 >2014-01-30 07:31:56,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7e748d99 >2014-01-30 07:31:56,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 267b603f >2014-01-30 07:31:56,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 267b603f >2014-01-30 07:32:01,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65c48c4e >2014-01-30 07:32:02,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 65c48c4e >2014-01-30 07:32:02,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e05b5ce >2014-01-30 07:32:02,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c983832c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fee2c4ed}, log id: 6e05b5ce >2014-01-30 07:32:02,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 46e010d >2014-01-30 07:32:03,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 46e010d >2014-01-30 07:32:03,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c1f71c6 >2014-01-30 07:32:03,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c1f71c6 >2014-01-30 07:32:05,915 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-82) [4eafa082] No up server in cluster >2014-01-30 07:32:05,916 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-82) [4eafa082] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:32:05,918 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-82) [4eafa082] No up server in cluster >2014-01-30 07:32:05,918 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-82) [4eafa082] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:32:05,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 4b74bcbc >2014-01-30 07:32:06,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4b74bcbc >2014-01-30 07:32:06,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6581f17e >2014-01-30 07:32:06,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterTasksListVDSCommand, return: [], log id: 6581f17e >2014-01-30 07:32:08,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a65b25d >2014-01-30 07:32:08,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a65b25d >2014-01-30 07:32:08,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c815984 >2014-01-30 07:32:09,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96f971ca, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f950d0ec}, log id: 6c815984 >2014-01-30 07:32:09,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 86da5c2 >2014-01-30 07:32:09,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 86da5c2 >2014-01-30 07:32:09,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 25baa039 >2014-01-30 07:32:09,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25baa039 >2014-01-30 07:32:15,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 63371a2a >2014-01-30 07:32:15,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 63371a2a >2014-01-30 07:32:15,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1173071 >2014-01-30 07:32:15,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4cd2fc4b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3bf0f91}, log id: 1173071 >2014-01-30 07:32:15,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 26b9a688 >2014-01-30 07:32:16,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 26b9a688 >2014-01-30 07:32:16,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 335c517e >2014-01-30 07:32:16,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 335c517e >2014-01-30 07:32:21,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f7ade26 >2014-01-30 07:32:22,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4f7ade26 >2014-01-30 07:32:22,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 715583ec >2014-01-30 07:32:22,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1575a43d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d269c190}, log id: 715583ec >2014-01-30 07:32:22,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5e4f114e >2014-01-30 07:32:22,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5e4f114e >2014-01-30 07:32:22,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 46f31191 >2014-01-30 07:32:23,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46f31191 >2014-01-30 07:32:28,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 308f018d >2014-01-30 07:32:28,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 308f018d >2014-01-30 07:32:28,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49bf2c4 >2014-01-30 07:32:28,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fc27481, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42349a99}, log id: 49bf2c4 >2014-01-30 07:32:28,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6c6e269e >2014-01-30 07:32:29,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6c6e269e >2014-01-30 07:32:29,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 46cf1580 >2014-01-30 07:32:29,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 46cf1580 >2014-01-30 07:32:34,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43edb750 >2014-01-30 07:32:35,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43edb750 >2014-01-30 07:32:35,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f0cb935 >2014-01-30 07:32:35,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47173e4f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa489e43}, log id: 1f0cb935 >2014-01-30 07:32:35,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 70b254b2 >2014-01-30 07:32:35,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 70b254b2 >2014-01-30 07:32:35,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1854748e >2014-01-30 07:32:36,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1854748e >2014-01-30 07:32:41,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13412127 >2014-01-30 07:32:41,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 13412127 >2014-01-30 07:32:41,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 209d88cb >2014-01-30 07:32:41,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6e0e957, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af562fae}, log id: 209d88cb >2014-01-30 07:32:41,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4ab994d9 >2014-01-30 07:32:42,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4ab994d9 >2014-01-30 07:32:42,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 600171f0 >2014-01-30 07:32:42,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 600171f0 >2014-01-30 07:32:47,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d8d1a46 >2014-01-30 07:32:48,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1d8d1a46 >2014-01-30 07:32:48,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ff3cf3f >2014-01-30 07:32:48,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fdd41f14, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c620227}, log id: ff3cf3f >2014-01-30 07:32:48,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3b3877cc >2014-01-30 07:32:49,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3b3877cc >2014-01-30 07:32:49,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7be59a12 >2014-01-30 07:32:49,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7be59a12 >2014-01-30 07:32:54,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79e5427 >2014-01-30 07:32:54,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 79e5427 >2014-01-30 07:32:54,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d41ceba >2014-01-30 07:32:55,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f54a7dfc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d7e2525}, log id: 3d41ceba >2014-01-30 07:32:55,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 8cc24d2 >2014-01-30 07:32:55,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 8cc24d2 >2014-01-30 07:32:55,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 12bb6b40 >2014-01-30 07:32:55,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12bb6b40 >2014-01-30 07:33:00,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a622155 >2014-01-30 07:33:01,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4a622155 >2014-01-30 07:33:01,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4dd8204e >2014-01-30 07:33:01,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6febe143, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59d96950}, log id: 4dd8204e >2014-01-30 07:33:01,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7c2b1e63 >2014-01-30 07:33:02,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7c2b1e63 >2014-01-30 07:33:02,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4c136a60 >2014-01-30 07:33:02,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c136a60 >2014-01-30 07:33:06,733 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) [1f17c565] No up server in cluster >2014-01-30 07:33:06,734 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) [1f17c565] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:33:06,738 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-35) [1f17c565] No up server in cluster >2014-01-30 07:33:06,738 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-35) [1f17c565] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:33:06,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e9bfeb9 >2014-01-30 07:33:07,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: e9bfeb9 >2014-01-30 07:33:07,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 318cc38 >2014-01-30 07:33:07,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 104ffa15 >2014-01-30 07:33:07,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterTasksListVDSCommand, return: [], log id: 318cc38 >2014-01-30 07:33:07,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 104ffa15 >2014-01-30 07:33:07,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 358df2e8 >2014-01-30 07:33:08,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5251734, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d59a960a}, log id: 358df2e8 >2014-01-30 07:33:08,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 588a441 >2014-01-30 07:33:08,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 588a441 >2014-01-30 07:33:08,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 743bcd57 >2014-01-30 07:33:08,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 743bcd57 >2014-01-30 07:33:13,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1afc6afe >2014-01-30 07:33:14,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1afc6afe >2014-01-30 07:33:14,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66987729 >2014-01-30 07:33:14,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88d85952, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b9e6a70}, log id: 66987729 >2014-01-30 07:33:14,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5b34094e >2014-01-30 07:33:15,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5b34094e >2014-01-30 07:33:15,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4c0342d9 >2014-01-30 07:33:15,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c0342d9 >2014-01-30 07:33:20,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a5bd818 >2014-01-30 07:33:20,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5a5bd818 >2014-01-30 07:33:20,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4dfb07e2 >2014-01-30 07:33:21,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7062217a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bcc491e}, log id: 4dfb07e2 >2014-01-30 07:33:21,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 45d5fe3f >2014-01-30 07:33:21,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 45d5fe3f >2014-01-30 07:33:21,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 43f8e3d8 >2014-01-30 07:33:21,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43f8e3d8 >2014-01-30 07:33:26,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17a043a1 >2014-01-30 07:33:27,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 17a043a1 >2014-01-30 07:33:27,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 536b1ced >2014-01-30 07:33:27,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@574242b4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79b03c46}, log id: 536b1ced >2014-01-30 07:33:27,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 18fae84 >2014-01-30 07:33:28,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 18fae84 >2014-01-30 07:33:28,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a71508 >2014-01-30 07:33:28,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a71508 >2014-01-30 07:33:33,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 73b5766e >2014-01-30 07:33:34,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 73b5766e >2014-01-30 07:33:34,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7125f917 >2014-01-30 07:33:34,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e89bf39, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2a5f548}, log id: 7125f917 >2014-01-30 07:33:34,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 46ff0aab >2014-01-30 07:33:34,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 46ff0aab >2014-01-30 07:33:34,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6bc8f682 >2014-01-30 07:33:35,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6bc8f682 >2014-01-30 07:33:40,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23d76788 >2014-01-30 07:33:40,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 23d76788 >2014-01-30 07:33:40,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ae0255f >2014-01-30 07:33:40,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c53a4790, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@448da03e}, log id: 4ae0255f >2014-01-30 07:33:40,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7e9f9430 >2014-01-30 07:33:41,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7e9f9430 >2014-01-30 07:33:41,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 742bf530 >2014-01-30 07:33:41,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 742bf530 >2014-01-30 07:33:46,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14b2310b >2014-01-30 07:33:47,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 14b2310b >2014-01-30 07:33:47,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d84dc08 >2014-01-30 07:33:47,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3909e8d4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ceba5ece}, log id: 2d84dc08 >2014-01-30 07:33:47,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2d89c7d6 >2014-01-30 07:33:47,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2d89c7d6 >2014-01-30 07:33:47,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2fcd7fc0 >2014-01-30 07:33:48,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2fcd7fc0 >2014-01-30 07:33:53,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 531ad65b >2014-01-30 07:33:53,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 531ad65b >2014-01-30 07:33:53,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 63c7b79c >2014-01-30 07:33:53,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@717f0106, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7882d631}, log id: 63c7b79c >2014-01-30 07:33:53,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3e7b8657 >2014-01-30 07:33:54,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3e7b8657 >2014-01-30 07:33:54,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7463ab6d >2014-01-30 07:33:54,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7463ab6d >2014-01-30 07:33:59,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1064ee11 >2014-01-30 07:34:00,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1064ee11 >2014-01-30 07:34:00,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a6fcb0d >2014-01-30 07:34:00,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2950ff95, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df399213}, log id: 5a6fcb0d >2014-01-30 07:34:00,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d6da24d >2014-01-30 07:34:01,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7d6da24d >2014-01-30 07:34:01,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2a13aabc >2014-01-30 07:34:01,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a13aabc >2014-01-30 07:34:06,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4838a291 >2014-01-30 07:34:06,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4838a291 >2014-01-30 07:34:06,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a00ac33 >2014-01-30 07:34:07,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a95121d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86bf4021}, log id: 7a00ac33 >2014-01-30 07:34:07,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 663c0a1c >2014-01-30 07:34:07,528 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-70) No up server in cluster >2014-01-30 07:34:07,528 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-70) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:34:07,531 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-70) No up server in cluster >2014-01-30 07:34:07,531 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-70) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:34:07,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 32a019a1 >2014-01-30 07:34:07,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 663c0a1c >2014-01-30 07:34:07,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2c03f015 >2014-01-30 07:34:07,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c03f015 >2014-01-30 07:34:08,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 32a019a1 >2014-01-30 07:34:08,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3a6f3999 >2014-01-30 07:34:08,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3a6f3999 >2014-01-30 07:34:12,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5da370a5 >2014-01-30 07:34:13,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5da370a5 >2014-01-30 07:34:13,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 343b46e5 >2014-01-30 07:34:13,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2992691f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9093a2e}, log id: 343b46e5 >2014-01-30 07:34:13,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1244203d >2014-01-30 07:34:14,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1244203d >2014-01-30 07:34:14,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 22256438 >2014-01-30 07:34:14,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 22256438 >2014-01-30 07:34:19,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11044780 >2014-01-30 07:34:19,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 11044780 >2014-01-30 07:34:19,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e0fda20 >2014-01-30 07:34:20,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a85842b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7811c147}, log id: 6e0fda20 >2014-01-30 07:34:20,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 24b4d158 >2014-01-30 07:34:20,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 24b4d158 >2014-01-30 07:34:20,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4dc51819 >2014-01-30 07:34:20,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4dc51819 >2014-01-30 07:34:25,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 55ef2985 >2014-01-30 07:34:26,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 55ef2985 >2014-01-30 07:34:26,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 73460cc3 >2014-01-30 07:34:26,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d73126c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f8b960d}, log id: 73460cc3 >2014-01-30 07:34:26,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 28cd6191 >2014-01-30 07:34:27,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 28cd6191 >2014-01-30 07:34:27,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3d1e96d9 >2014-01-30 07:34:27,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d1e96d9 >2014-01-30 07:34:32,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ffcbe49 >2014-01-30 07:34:32,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7ffcbe49 >2014-01-30 07:34:32,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56db89c3 >2014-01-30 07:34:33,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@687dc35f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6e7a0b5}, log id: 56db89c3 >2014-01-30 07:34:33,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 176c2949 >2014-01-30 07:34:33,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 176c2949 >2014-01-30 07:34:33,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 33d620b5 >2014-01-30 07:34:33,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33d620b5 >2014-01-30 07:34:39,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21538ab0 >2014-01-30 07:34:39,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 21538ab0 >2014-01-30 07:34:39,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7fb5c547 >2014-01-30 07:34:39,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@147ae1bd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4337121c}, log id: 7fb5c547 >2014-01-30 07:34:39,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 612f66ee >2014-01-30 07:34:40,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 612f66ee >2014-01-30 07:34:40,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 662c4747 >2014-01-30 07:34:40,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 662c4747 >2014-01-30 07:34:45,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 75cebecd >2014-01-30 07:34:46,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 75cebecd >2014-01-30 07:34:46,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46e50db8 >2014-01-30 07:34:46,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0923b11, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33cd3886}, log id: 46e50db8 >2014-01-30 07:34:46,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 72e4983e >2014-01-30 07:34:46,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 72e4983e >2014-01-30 07:34:46,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 663e80ef >2014-01-30 07:34:47,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 663e80ef >2014-01-30 07:34:52,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c36759a >2014-01-30 07:34:52,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: c36759a >2014-01-30 07:34:52,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6751d7f9 >2014-01-30 07:34:52,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6229777, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84ba884a}, log id: 6751d7f9 >2014-01-30 07:34:52,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 772eb327 >2014-01-30 07:34:53,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 772eb327 >2014-01-30 07:34:53,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4478e098 >2014-01-30 07:34:53,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4478e098 >2014-01-30 07:34:58,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4cbc92d0 >2014-01-30 07:34:59,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4cbc92d0 >2014-01-30 07:34:59,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 750d23af >2014-01-30 07:34:59,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb8d8dd9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa53a818}, log id: 750d23af >2014-01-30 07:34:59,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 618af991 >2014-01-30 07:34:59,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 618af991 >2014-01-30 07:34:59,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 410061ea >2014-01-30 07:35:00,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 410061ea >2014-01-30 07:35:05,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ebbcc8 >2014-01-30 07:35:05,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3ebbcc8 >2014-01-30 07:35:05,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 422c0186 >2014-01-30 07:35:06,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a0ba183, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6c9ba82}, log id: 422c0186 >2014-01-30 07:35:06,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: dc9160c >2014-01-30 07:35:06,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: dc9160c >2014-01-30 07:35:06,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 894d289 >2014-01-30 07:35:06,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 894d289 >2014-01-30 07:35:08,577 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-10) [641a6d1] No up server in cluster >2014-01-30 07:35:08,577 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-10) [641a6d1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:35:08,580 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-10) [641a6d1] No up server in cluster >2014-01-30 07:35:08,581 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-10) [641a6d1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:35:08,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2930945a >2014-01-30 07:35:09,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 2930945a >2014-01-30 07:35:09,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 345a395f >2014-01-30 07:35:09,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterTasksListVDSCommand, return: [], log id: 345a395f >2014-01-30 07:35:11,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26a9707f >2014-01-30 07:35:12,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 26a9707f >2014-01-30 07:35:12,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ca6e9a3 >2014-01-30 07:35:12,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c20d98fa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ade21c37}, log id: 2ca6e9a3 >2014-01-30 07:35:12,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5fa6f0f6 >2014-01-30 07:35:13,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5fa6f0f6 >2014-01-30 07:35:13,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 71fa171e >2014-01-30 07:35:13,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71fa171e >2014-01-30 07:35:14,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 729e9bb9 >2014-01-30 07:35:14,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@e101e2c, log id: 729e9bb9 >2014-01-30 07:35:14,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 442ce1ea >2014-01-30 07:35:15,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1edfe42b, log id: 442ce1ea >2014-01-30 07:35:18,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b546f50 >2014-01-30 07:35:18,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b546f50 >2014-01-30 07:35:18,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3bc5ae1f >2014-01-30 07:35:19,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4ca9772, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89a02d23}, log id: 3bc5ae1f >2014-01-30 07:35:19,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1c9099e4 >2014-01-30 07:35:19,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1c9099e4 >2014-01-30 07:35:19,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6a8e2e1 >2014-01-30 07:35:19,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a8e2e1 >2014-01-30 07:35:24,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a4a3ea5 >2014-01-30 07:35:25,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2a4a3ea5 >2014-01-30 07:35:25,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d947cb9 >2014-01-30 07:35:25,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b7100dc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c42ccca}, log id: 1d947cb9 >2014-01-30 07:35:25,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 34ac085e >2014-01-30 07:35:26,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 34ac085e >2014-01-30 07:35:26,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 47536a3d >2014-01-30 07:35:26,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 47536a3d >2014-01-30 07:35:31,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 668482a9 >2014-01-30 07:35:31,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 668482a9 >2014-01-30 07:35:31,995 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 797544c2 >2014-01-30 07:35:32,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2617d7e4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8533d84}, log id: 797544c2 >2014-01-30 07:35:32,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 11ea4f3c >2014-01-30 07:35:32,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 11ea4f3c >2014-01-30 07:35:32,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7f8b3c1c >2014-01-30 07:35:33,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f8b3c1c >2014-01-30 07:35:38,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30f7a875 >2014-01-30 07:35:38,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 30f7a875 >2014-01-30 07:35:38,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7027ecce >2014-01-30 07:35:38,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21be2743, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97085967}, log id: 7027ecce >2014-01-30 07:35:38,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2eb2fbff >2014-01-30 07:35:39,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2eb2fbff >2014-01-30 07:35:39,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 54a31af8 >2014-01-30 07:35:39,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54a31af8 >2014-01-30 07:35:44,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ce72819 >2014-01-30 07:35:45,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: ce72819 >2014-01-30 07:35:45,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4985539 >2014-01-30 07:35:45,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b04a6a34, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cbf9fa}, log id: 4985539 >2014-01-30 07:35:45,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6fb48757 >2014-01-30 07:35:45,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6fb48757 >2014-01-30 07:35:45,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 61d418bf >2014-01-30 07:35:46,141 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61d418bf >2014-01-30 07:35:51,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79511c3b >2014-01-30 07:35:51,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 79511c3b >2014-01-30 07:35:51,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 609cd8d7 >2014-01-30 07:35:51,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bec44305, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f7d772}, log id: 609cd8d7 >2014-01-30 07:35:51,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 74117ba3 >2014-01-30 07:35:52,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 74117ba3 >2014-01-30 07:35:52,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1519b746 >2014-01-30 07:35:52,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1519b746 >2014-01-30 07:35:57,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 233c0f47 >2014-01-30 07:35:58,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 233c0f47 >2014-01-30 07:35:58,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 560bf1ab >2014-01-30 07:35:58,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c0bb733, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6bab47f0}, log id: 560bf1ab >2014-01-30 07:35:58,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d8a5e41 >2014-01-30 07:35:59,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7d8a5e41 >2014-01-30 07:35:59,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a12deae >2014-01-30 07:35:59,266 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a12deae >2014-01-30 07:36:04,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ec0f1a >2014-01-30 07:36:04,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6ec0f1a >2014-01-30 07:36:04,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c336f2b >2014-01-30 07:36:05,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b894989, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ab27280}, log id: c336f2b >2014-01-30 07:36:05,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3abf6aa9 >2014-01-30 07:36:05,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3abf6aa9 >2014-01-30 07:36:05,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 436af538 >2014-01-30 07:36:05,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 436af538 >2014-01-30 07:36:09,372 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) [4376cca4] No up server in cluster >2014-01-30 07:36:09,372 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) [4376cca4] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:36:09,375 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-85) [4376cca4] No up server in cluster >2014-01-30 07:36:09,375 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-85) [4376cca4] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:36:09,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d8078d2 >2014-01-30 07:36:09,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 6d8078d2 >2014-01-30 07:36:09,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b50ea50 >2014-01-30 07:36:10,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterTasksListVDSCommand, return: [], log id: 2b50ea50 >2014-01-30 07:36:10,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 379a2f61 >2014-01-30 07:36:11,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 379a2f61 >2014-01-30 07:36:11,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d11d4a6 >2014-01-30 07:36:11,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4f1dd8b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@109a26f4}, log id: 7d11d4a6 >2014-01-30 07:36:11,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: c0dfe2f >2014-01-30 07:36:12,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: c0dfe2f >2014-01-30 07:36:12,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 128ea4c8 >2014-01-30 07:36:12,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 128ea4c8 >2014-01-30 07:36:17,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 345bf814 >2014-01-30 07:36:17,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 345bf814 >2014-01-30 07:36:17,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2edc5041 >2014-01-30 07:36:18,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b752ccf6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db6a33bd}, log id: 2edc5041 >2014-01-30 07:36:18,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 737c5666 >2014-01-30 07:36:18,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 737c5666 >2014-01-30 07:36:18,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6d743db7 >2014-01-30 07:36:18,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d743db7 >2014-01-30 07:36:23,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17d0bcc8 >2014-01-30 07:36:24,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 17d0bcc8 >2014-01-30 07:36:24,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 438c4e0 >2014-01-30 07:36:24,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d64ba4c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f43657e}, log id: 438c4e0 >2014-01-30 07:36:24,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 900ad20 >2014-01-30 07:36:25,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 900ad20 >2014-01-30 07:36:25,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5361809e >2014-01-30 07:36:25,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5361809e >2014-01-30 07:36:30,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77a5a33 >2014-01-30 07:36:31,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 77a5a33 >2014-01-30 07:36:31,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 34080f0 >2014-01-30 07:36:31,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e26de349, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@126ab681}, log id: 34080f0 >2014-01-30 07:36:31,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1ee5c9fd >2014-01-30 07:36:31,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1ee5c9fd >2014-01-30 07:36:31,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3aee57 >2014-01-30 07:36:32,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3aee57 >2014-01-30 07:36:37,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a1048f >2014-01-30 07:36:37,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a1048f >2014-01-30 07:36:37,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 587b4732 >2014-01-30 07:36:37,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d35562a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@787c3389}, log id: 587b4732 >2014-01-30 07:36:37,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 347ed1e9 >2014-01-30 07:36:38,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 347ed1e9 >2014-01-30 07:36:38,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1418fd1 >2014-01-30 07:36:38,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1418fd1 >2014-01-30 07:36:43,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4716abd0 >2014-01-30 07:36:44,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4716abd0 >2014-01-30 07:36:44,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 416b2da1 >2014-01-30 07:36:44,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69defeaf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9426bc1b}, log id: 416b2da1 >2014-01-30 07:36:44,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 10657985 >2014-01-30 07:36:44,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 10657985 >2014-01-30 07:36:44,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ff2fa8b >2014-01-30 07:36:45,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ff2fa8b >2014-01-30 07:36:50,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 55e8bc9c >2014-01-30 07:36:50,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 55e8bc9c >2014-01-30 07:36:50,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e7f61d5 >2014-01-30 07:36:50,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@208d8973, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1bd30cb}, log id: 5e7f61d5 >2014-01-30 07:36:50,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 57fd2c6d >2014-01-30 07:36:51,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 57fd2c6d >2014-01-30 07:36:51,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5eea2f6c >2014-01-30 07:36:51,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5eea2f6c >2014-01-30 07:36:56,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 57a0df4 >2014-01-30 07:36:57,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 57a0df4 >2014-01-30 07:36:57,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4923f5d1 >2014-01-30 07:36:57,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d583028, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb2599cf}, log id: 4923f5d1 >2014-01-30 07:36:57,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 35496bf0 >2014-01-30 07:36:58,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 35496bf0 >2014-01-30 07:36:58,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 21c0fc90 >2014-01-30 07:36:58,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21c0fc90 >2014-01-30 07:37:03,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 39e23bca >2014-01-30 07:37:03,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 39e23bca >2014-01-30 07:37:03,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60233a5 >2014-01-30 07:37:04,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7bf2461, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7abbb10e}, log id: 60233a5 >2014-01-30 07:37:04,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 763c358b >2014-01-30 07:37:04,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 763c358b >2014-01-30 07:37:04,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 80c5015 >2014-01-30 07:37:04,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 80c5015 >2014-01-30 07:37:09,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72c0d6d5 >2014-01-30 07:37:10,181 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] No up server in cluster >2014-01-30 07:37:10,181 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:37:10,184 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] No up server in cluster >2014-01-30 07:37:10,184 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:37:10,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 4bc4623f >2014-01-30 07:37:10,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 72c0d6d5 >2014-01-30 07:37:10,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c75580d >2014-01-30 07:37:10,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ee484a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc77aa18}, log id: 2c75580d >2014-01-30 07:37:10,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77ddde55 >2014-01-30 07:37:10,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4bc4623f >2014-01-30 07:37:10,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 188bad54 >2014-01-30 07:37:10,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterTasksListVDSCommand, return: [], log id: 188bad54 >2014-01-30 07:37:11,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 77ddde55 >2014-01-30 07:37:11,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 127c3684 >2014-01-30 07:37:11,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 127c3684 >2014-01-30 07:37:16,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f35b656 >2014-01-30 07:37:16,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1f35b656 >2014-01-30 07:37:16,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 477832cb >2014-01-30 07:37:17,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47a52321, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa2e16a9}, log id: 477832cb >2014-01-30 07:37:17,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d8201e2 >2014-01-30 07:37:17,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7d8201e2 >2014-01-30 07:37:17,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 27eb5915 >2014-01-30 07:37:17,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27eb5915 >2014-01-30 07:37:22,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 63985635 >2014-01-30 07:37:23,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 63985635 >2014-01-30 07:37:23,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14e3af8a >2014-01-30 07:37:23,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43202081, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb54fe9d}, log id: 14e3af8a >2014-01-30 07:37:23,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 231c8fd3 >2014-01-30 07:37:24,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 231c8fd3 >2014-01-30 07:37:24,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5ad419f3 >2014-01-30 07:37:24,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ad419f3 >2014-01-30 07:37:29,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 643ac662 >2014-01-30 07:37:30,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 643ac662 >2014-01-30 07:37:30,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 247d8870 >2014-01-30 07:37:30,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3c90d81, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@897d21c7}, log id: 247d8870 >2014-01-30 07:37:30,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2c9b45f6 >2014-01-30 07:37:30,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2c9b45f6 >2014-01-30 07:37:30,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2d15667a >2014-01-30 07:37:31,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2d15667a >2014-01-30 07:37:36,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48817e83 >2014-01-30 07:37:36,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 48817e83 >2014-01-30 07:37:36,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42c6ab3a >2014-01-30 07:37:36,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e940837c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d42d00a}, log id: 42c6ab3a >2014-01-30 07:37:36,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 293c63bd >2014-01-30 07:37:37,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 293c63bd >2014-01-30 07:37:37,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3da597e8 >2014-01-30 07:37:37,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3da597e8 >2014-01-30 07:37:42,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33b736b7 >2014-01-30 07:37:43,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 33b736b7 >2014-01-30 07:37:43,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1fb7b3d1 >2014-01-30 07:37:43,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3acde3e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f08d71b5}, log id: 1fb7b3d1 >2014-01-30 07:37:43,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 73ff2f9a >2014-01-30 07:37:43,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 73ff2f9a >2014-01-30 07:37:43,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 725b38c3 >2014-01-30 07:37:44,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 725b38c3 >2014-01-30 07:37:49,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a71de8d >2014-01-30 07:37:49,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2a71de8d >2014-01-30 07:37:49,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f1657c5 >2014-01-30 07:37:49,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6bfbeda, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@735dc880}, log id: 6f1657c5 >2014-01-30 07:37:49,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 471b3c62 >2014-01-30 07:37:50,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 471b3c62 >2014-01-30 07:37:50,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4f6120e6 >2014-01-30 07:37:50,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4f6120e6 >2014-01-30 07:37:55,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3683d20d >2014-01-30 07:37:56,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3683d20d >2014-01-30 07:37:56,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4936e3f1 >2014-01-30 07:37:56,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61f2e6c1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bd12c77}, log id: 4936e3f1 >2014-01-30 07:37:56,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2790a43b >2014-01-30 07:37:56,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2790a43b >2014-01-30 07:37:56,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 70d97d14 >2014-01-30 07:37:57,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70d97d14 >2014-01-30 07:38:02,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53a8c220 >2014-01-30 07:38:02,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 53a8c220 >2014-01-30 07:38:02,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d44b617 >2014-01-30 07:38:02,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@399f764b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79377d57}, log id: 6d44b617 >2014-01-30 07:38:03,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4b71dbd5 >2014-01-30 07:38:03,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4b71dbd5 >2014-01-30 07:38:03,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6bb5e1b4 >2014-01-30 07:38:03,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6bb5e1b4 >2014-01-30 07:38:08,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 657894bb >2014-01-30 07:38:09,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 657894bb >2014-01-30 07:38:09,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ce439a7 >2014-01-30 07:38:09,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0349ec2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56ce477a}, log id: 4ce439a7 >2014-01-30 07:38:09,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6db0a839 >2014-01-30 07:38:10,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6db0a839 >2014-01-30 07:38:10,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ace4791 >2014-01-30 07:38:10,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ace4791 >2014-01-30 07:38:10,956 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-74) [61851da7] No up server in cluster >2014-01-30 07:38:10,957 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-74) [61851da7] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:38:10,959 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-74) [61851da7] No up server in cluster >2014-01-30 07:38:10,959 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-74) [61851da7] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:38:10,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: fa476af >2014-01-30 07:38:11,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: fa476af >2014-01-30 07:38:11,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 110c15c3 >2014-01-30 07:38:11,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterTasksListVDSCommand, return: [], log id: 110c15c3 >2014-01-30 07:38:15,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 748db395 >2014-01-30 07:38:15,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 748db395 >2014-01-30 07:38:15,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4fefda9a >2014-01-30 07:38:16,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db2c9c81, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2178cde}, log id: 4fefda9a >2014-01-30 07:38:16,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 17880934 >2014-01-30 07:38:16,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 17880934 >2014-01-30 07:38:16,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 41cbe17c >2014-01-30 07:38:16,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41cbe17c >2014-01-30 07:38:21,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 705fd55e >2014-01-30 07:38:22,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 705fd55e >2014-01-30 07:38:22,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7337b2c4 >2014-01-30 07:38:22,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ca7fdc6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@157a155c}, log id: 7337b2c4 >2014-01-30 07:38:22,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4a4af989 >2014-01-30 07:38:23,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4a4af989 >2014-01-30 07:38:23,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1fbd0095 >2014-01-30 07:38:23,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fbd0095 >2014-01-30 07:38:28,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3bc20a01 >2014-01-30 07:38:28,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3bc20a01 >2014-01-30 07:38:28,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 28e8bd3a >2014-01-30 07:38:29,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac64910c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e17637bc}, log id: 28e8bd3a >2014-01-30 07:38:29,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3401d51b >2014-01-30 07:38:29,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3401d51b >2014-01-30 07:38:29,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ec9dd56 >2014-01-30 07:38:29,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6ec9dd56 >2014-01-30 07:38:34,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3cfc92d2 >2014-01-30 07:38:35,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3cfc92d2 >2014-01-30 07:38:35,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 560fd1f1 >2014-01-30 07:38:35,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@808e08f8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e10b8dd6}, log id: 560fd1f1 >2014-01-30 07:38:35,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 43a82fde >2014-01-30 07:38:36,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 43a82fde >2014-01-30 07:38:36,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 15caec0a >2014-01-30 07:38:36,544 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15caec0a >2014-01-30 07:38:41,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40f624e4 >2014-01-30 07:38:42,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 40f624e4 >2014-01-30 07:38:42,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f2e34d0 >2014-01-30 07:38:42,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b19c6a51, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64655ab8}, log id: 3f2e34d0 >2014-01-30 07:38:42,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3dec75e1 >2014-01-30 07:38:42,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3dec75e1 >2014-01-30 07:38:42,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 62e2158d >2014-01-30 07:38:43,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62e2158d >2014-01-30 07:38:48,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2fdb7ada >2014-01-30 07:38:48,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2fdb7ada >2014-01-30 07:38:48,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22fb45c6 >2014-01-30 07:38:48,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@779b9e23, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@346e9ad7}, log id: 22fb45c6 >2014-01-30 07:38:48,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 603e00b3 >2014-01-30 07:38:49,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 603e00b3 >2014-01-30 07:38:49,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6c49f92a >2014-01-30 07:38:49,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c49f92a >2014-01-30 07:38:54,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e28cebc >2014-01-30 07:38:55,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: e28cebc >2014-01-30 07:38:55,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79c7c9d2 >2014-01-30 07:38:55,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99286656, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7dd669dc}, log id: 79c7c9d2 >2014-01-30 07:38:55,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5ee66def >2014-01-30 07:38:55,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5ee66def >2014-01-30 07:38:55,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1de17820 >2014-01-30 07:38:56,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1de17820 >2014-01-30 07:39:01,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2479cb35 >2014-01-30 07:39:01,733 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2479cb35 >2014-01-30 07:39:01,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7432f9e0 >2014-01-30 07:39:02,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4faa824a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@942b7e67}, log id: 7432f9e0 >2014-01-30 07:39:02,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6a971697 >2014-01-30 07:39:02,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6a971697 >2014-01-30 07:39:02,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: a18d463 >2014-01-30 07:39:02,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a18d463 >2014-01-30 07:39:07,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6eb77ebf >2014-01-30 07:39:08,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6eb77ebf >2014-01-30 07:39:08,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41d37e17 >2014-01-30 07:39:08,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e066cfe, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6f0994e}, log id: 41d37e17 >2014-01-30 07:39:08,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 69ee5435 >2014-01-30 07:39:09,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 69ee5435 >2014-01-30 07:39:09,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1a1eeb46 >2014-01-30 07:39:09,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a1eeb46 >2014-01-30 07:39:11,837 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] No up server in cluster >2014-01-30 07:39:11,838 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:39:11,841 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] No up server in cluster >2014-01-30 07:39:11,841 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:39:11,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 74eadb0e >2014-01-30 07:39:12,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 74eadb0e >2014-01-30 07:39:12,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 35afb916 >2014-01-30 07:39:12,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterTasksListVDSCommand, return: [], log id: 35afb916 >2014-01-30 07:39:14,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7276f2ca >2014-01-30 07:39:14,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7276f2ca >2014-01-30 07:39:14,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7680a851 >2014-01-30 07:39:15,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60c25c1a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8143ca58}, log id: 7680a851 >2014-01-30 07:39:15,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: e716e5 >2014-01-30 07:39:15,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: e716e5 >2014-01-30 07:39:15,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 697647 >2014-01-30 07:39:15,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 697647 >2014-01-30 07:39:20,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9b32c5e >2014-01-30 07:39:21,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 9b32c5e >2014-01-30 07:39:21,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 55a2d670 >2014-01-30 07:39:21,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccafd9b8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cbb6a22}, log id: 55a2d670 >2014-01-30 07:39:21,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7c357cb6 >2014-01-30 07:39:22,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7c357cb6 >2014-01-30 07:39:22,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 24ba3d64 >2014-01-30 07:39:22,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24ba3d64 >2014-01-30 07:39:27,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d0a43e1 >2014-01-30 07:39:27,953 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2d0a43e1 >2014-01-30 07:39:27,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3bc492ed >2014-01-30 07:39:28,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4ccaa27, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16a58173}, log id: 3bc492ed >2014-01-30 07:39:28,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 759c7cde >2014-01-30 07:39:28,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 759c7cde >2014-01-30 07:39:28,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 702b3750 >2014-01-30 07:39:29,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 702b3750 >2014-01-30 07:39:34,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7aa0b10a >2014-01-30 07:39:34,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7aa0b10a >2014-01-30 07:39:34,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c90f6c2 >2014-01-30 07:39:34,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b79830f2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67cdc094}, log id: 2c90f6c2 >2014-01-30 07:39:34,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6353360b >2014-01-30 07:39:35,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6353360b >2014-01-30 07:39:35,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 60508b8b >2014-01-30 07:39:35,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60508b8b >2014-01-30 07:39:40,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c6c786d >2014-01-30 07:39:41,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4c6c786d >2014-01-30 07:39:41,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1eb91efe >2014-01-30 07:39:41,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2b2e47f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5320e542}, log id: 1eb91efe >2014-01-30 07:39:41,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7ba11f49 >2014-01-30 07:39:41,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7ba11f49 >2014-01-30 07:39:41,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7824f214 >2014-01-30 07:39:42,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7824f214 >2014-01-30 07:39:47,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72a3652e >2014-01-30 07:39:47,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 72a3652e >2014-01-30 07:39:47,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 698b70e1 >2014-01-30 07:39:47,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5a74a5b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c43aed9}, log id: 698b70e1 >2014-01-30 07:39:48,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 513be76 >2014-01-30 07:39:48,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 513be76 >2014-01-30 07:39:48,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 27ed35b6 >2014-01-30 07:39:48,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 27ed35b6 >2014-01-30 07:39:53,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1226f7dc >2014-01-30 07:39:54,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1226f7dc >2014-01-30 07:39:54,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 28b96a20 >2014-01-30 07:39:54,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@182c472, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31c1ff6e}, log id: 28b96a20 >2014-01-30 07:39:54,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 690ecaf8 >2014-01-30 07:39:55,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 690ecaf8 >2014-01-30 07:39:55,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5b14bc7 >2014-01-30 07:39:55,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b14bc7 >2014-01-30 07:40:00,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b6a0e69 >2014-01-30 07:40:00,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1b6a0e69 >2014-01-30 07:40:00,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 771d055b >2014-01-30 07:40:01,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@596800c3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c720de35}, log id: 771d055b >2014-01-30 07:40:01,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5734f2df >2014-01-30 07:40:01,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5734f2df >2014-01-30 07:40:01,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 201781a4 >2014-01-30 07:40:01,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 201781a4 >2014-01-30 07:40:06,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a232489 >2014-01-30 07:40:07,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4a232489 >2014-01-30 07:40:07,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6092d26b >2014-01-30 07:40:07,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b114f965, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@74457fdf}, log id: 6092d26b >2014-01-30 07:40:07,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 509359cd >2014-01-30 07:40:08,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 509359cd >2014-01-30 07:40:08,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 31532336 >2014-01-30 07:40:08,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31532336 >2014-01-30 07:40:12,681 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-68) No up server in cluster >2014-01-30 07:40:12,681 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-68) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:40:12,684 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-68) No up server in cluster >2014-01-30 07:40:12,684 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-68) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:40:12,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 5b50a787 >2014-01-30 07:40:13,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 5b50a787 >2014-01-30 07:40:13,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 22e61246 >2014-01-30 07:40:13,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a7f2ccd >2014-01-30 07:40:13,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterTasksListVDSCommand, return: [], log id: 22e61246 >2014-01-30 07:40:13,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4a7f2ccd >2014-01-30 07:40:13,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4769f095 >2014-01-30 07:40:14,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29881657, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed1b46e0}, log id: 4769f095 >2014-01-30 07:40:14,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: c7bcdf7 >2014-01-30 07:40:14,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: c7bcdf7 >2014-01-30 07:40:14,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 25b3fafc >2014-01-30 07:40:14,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25b3fafc >2014-01-30 07:40:15,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 5eb47cb >2014-01-30 07:40:15,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6e3753e7, log id: 5eb47cb >2014-01-30 07:40:15,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 72659b38 >2014-01-30 07:40:15,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2b2244df, log id: 72659b38 >2014-01-30 07:40:19,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64873f9b >2014-01-30 07:40:20,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 64873f9b >2014-01-30 07:40:20,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 258be84e >2014-01-30 07:40:20,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d073451b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a58d3b7e}, log id: 258be84e >2014-01-30 07:40:20,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4345a124 >2014-01-30 07:40:21,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4345a124 >2014-01-30 07:40:21,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4eb527a >2014-01-30 07:40:21,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4eb527a >2014-01-30 07:40:26,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 63d09601 >2014-01-30 07:40:27,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 63d09601 >2014-01-30 07:40:27,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17c7eef8 >2014-01-30 07:40:27,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9246ea8e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20b0accf}, log id: 17c7eef8 >2014-01-30 07:40:27,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2e5837eb >2014-01-30 07:40:27,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2e5837eb >2014-01-30 07:40:27,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 510edba2 >2014-01-30 07:40:28,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 510edba2 >2014-01-30 07:40:33,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ebf52c >2014-01-30 07:40:33,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7ebf52c >2014-01-30 07:40:33,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f443203 >2014-01-30 07:40:33,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@783f25b6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ca4d124}, log id: 7f443203 >2014-01-30 07:40:33,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 66d730ed >2014-01-30 07:40:34,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 66d730ed >2014-01-30 07:40:34,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2e7141f1 >2014-01-30 07:40:34,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e7141f1 >2014-01-30 07:40:39,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19a54f2f >2014-01-30 07:40:40,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 19a54f2f >2014-01-30 07:40:40,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6414b44f >2014-01-30 07:40:40,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81d68be2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd35c43b}, log id: 6414b44f >2014-01-30 07:40:40,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 74f364e9 >2014-01-30 07:40:40,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 74f364e9 >2014-01-30 07:40:40,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c5d21ad >2014-01-30 07:40:41,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c5d21ad >2014-01-30 07:40:46,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17936910 >2014-01-30 07:40:46,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 17936910 >2014-01-30 07:40:46,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13c188b3 >2014-01-30 07:40:47,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c4318dd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b7ac4ef}, log id: 13c188b3 >2014-01-30 07:40:47,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 74b59317 >2014-01-30 07:40:47,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 74b59317 >2014-01-30 07:40:47,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6dfa4939 >2014-01-30 07:40:47,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6dfa4939 >2014-01-30 07:40:52,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 792a6ebd >2014-01-30 07:40:53,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 792a6ebd >2014-01-30 07:40:53,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 767d1cec >2014-01-30 07:40:53,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@215a1dc6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0d91b21}, log id: 767d1cec >2014-01-30 07:40:53,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ccbd8d >2014-01-30 07:40:54,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3ccbd8d >2014-01-30 07:40:54,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 73fd8fbb >2014-01-30 07:40:54,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73fd8fbb >2014-01-30 07:40:59,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48304044 >2014-01-30 07:40:59,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 48304044 >2014-01-30 07:40:59,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4be16cf3 >2014-01-30 07:41:00,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba1ab0a7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6779f05b}, log id: 4be16cf3 >2014-01-30 07:41:00,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ebf6d7e >2014-01-30 07:41:00,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: ebf6d7e >2014-01-30 07:41:00,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 44398fcf >2014-01-30 07:41:00,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44398fcf >2014-01-30 07:41:05,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71ce17fe >2014-01-30 07:41:06,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 71ce17fe >2014-01-30 07:41:06,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67d59728 >2014-01-30 07:41:06,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b370009, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9a88877}, log id: 67d59728 >2014-01-30 07:41:06,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4660964a >2014-01-30 07:41:07,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4660964a >2014-01-30 07:41:07,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1c965619 >2014-01-30 07:41:07,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1c965619 >2014-01-30 07:41:12,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 462a69a4 >2014-01-30 07:41:12,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 462a69a4 >2014-01-30 07:41:12,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a53bc04 >2014-01-30 07:41:13,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10bbb60a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f1e1bcd}, log id: 2a53bc04 >2014-01-30 07:41:13,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1e957d7e >2014-01-30 07:41:13,484 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-34) [4af86af0] No up server in cluster >2014-01-30 07:41:13,484 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-34) [4af86af0] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:41:13,487 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-34) [4af86af0] No up server in cluster >2014-01-30 07:41:13,487 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-34) [4af86af0] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:41:13,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 21720411 >2014-01-30 07:41:13,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1e957d7e >2014-01-30 07:41:13,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 78825819 >2014-01-30 07:41:14,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78825819 >2014-01-30 07:41:14,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 21720411 >2014-01-30 07:41:14,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 3a8829d1 >2014-01-30 07:41:14,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterTasksListVDSCommand, return: [], log id: 3a8829d1 >2014-01-30 07:41:19,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f8d85ab >2014-01-30 07:41:19,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4f8d85ab >2014-01-30 07:41:19,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d0a6e67 >2014-01-30 07:41:19,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad53af47, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db6145f5}, log id: 6d0a6e67 >2014-01-30 07:41:19,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 106a2983 >2014-01-30 07:41:20,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 106a2983 >2014-01-30 07:41:20,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 24d84391 >2014-01-30 07:41:20,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24d84391 >2014-01-30 07:41:25,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40775685 >2014-01-30 07:41:26,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 40775685 >2014-01-30 07:41:26,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e566424 >2014-01-30 07:41:26,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c86d2ee, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd12749d}, log id: 3e566424 >2014-01-30 07:41:26,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7bb08540 >2014-01-30 07:41:26,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7bb08540 >2014-01-30 07:41:26,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6c9ae75 >2014-01-30 07:41:27,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c9ae75 >2014-01-30 07:41:32,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52ee0b11 >2014-01-30 07:41:32,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 52ee0b11 >2014-01-30 07:41:32,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ff04790 >2014-01-30 07:41:32,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d42545cb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f64b4500}, log id: 1ff04790 >2014-01-30 07:41:32,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7860ab94 >2014-01-30 07:41:33,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7860ab94 >2014-01-30 07:41:33,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 74483ffb >2014-01-30 07:41:33,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74483ffb >2014-01-30 07:41:38,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12069cb7 >2014-01-30 07:41:39,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 12069cb7 >2014-01-30 07:41:39,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58982428 >2014-01-30 07:41:39,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9839aa6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86756213}, log id: 58982428 >2014-01-30 07:41:39,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7b5760d0 >2014-01-30 07:41:39,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7b5760d0 >2014-01-30 07:41:39,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1d657c11 >2014-01-30 07:41:40,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d657c11 >2014-01-30 07:41:45,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4036c5af >2014-01-30 07:41:45,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4036c5af >2014-01-30 07:41:45,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1fccf2ee >2014-01-30 07:41:45,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c810b182, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6d4e891}, log id: 1fccf2ee >2014-01-30 07:41:45,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2f9fd49e >2014-01-30 07:41:46,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2f9fd49e >2014-01-30 07:41:46,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 58a88253 >2014-01-30 07:41:46,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58a88253 >2014-01-30 07:41:51,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d0cca0e >2014-01-30 07:41:52,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7d0cca0e >2014-01-30 07:41:52,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 784516fd >2014-01-30 07:41:52,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fc30d5c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5c16883}, log id: 784516fd >2014-01-30 07:41:52,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 364101b6 >2014-01-30 07:41:53,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 364101b6 >2014-01-30 07:41:53,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 20e095ea >2014-01-30 07:41:53,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20e095ea >2014-01-30 07:41:58,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 637e7890 >2014-01-30 07:41:58,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 637e7890 >2014-01-30 07:41:58,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 160a75b7 >2014-01-30 07:41:59,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1def73a7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@297e97de}, log id: 160a75b7 >2014-01-30 07:41:59,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4f0454ed >2014-01-30 07:41:59,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4f0454ed >2014-01-30 07:41:59,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 32508672 >2014-01-30 07:41:59,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 32508672 >2014-01-30 07:42:04,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c26f31b >2014-01-30 07:42:05,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1c26f31b >2014-01-30 07:42:05,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7990bf46 >2014-01-30 07:42:05,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4fd5e5d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@392d6ff8}, log id: 7990bf46 >2014-01-30 07:42:05,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2e355687 >2014-01-30 07:42:06,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2e355687 >2014-01-30 07:42:06,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1611eef1 >2014-01-30 07:42:06,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1611eef1 >2014-01-30 07:42:11,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6338dff1 >2014-01-30 07:42:11,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6338dff1 >2014-01-30 07:42:11,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 586ebbff >2014-01-30 07:42:12,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3313f6ba, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9cdcb9a}, log id: 586ebbff >2014-01-30 07:42:12,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 10c56604 >2014-01-30 07:42:12,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 10c56604 >2014-01-30 07:42:12,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3f144a49 >2014-01-30 07:42:12,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f144a49 >2014-01-30 07:42:14,344 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-58) [5c017a7a] No up server in cluster >2014-01-30 07:42:14,344 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-58) [5c017a7a] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:42:14,347 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-58) [5c017a7a] No up server in cluster >2014-01-30 07:42:14,348 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-58) [5c017a7a] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:42:14,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 4d82836f >2014-01-30 07:42:14,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4d82836f >2014-01-30 07:42:14,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1b811ed1 >2014-01-30 07:42:15,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterTasksListVDSCommand, return: [], log id: 1b811ed1 >2014-01-30 07:42:17,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49adb153 >2014-01-30 07:42:18,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 49adb153 >2014-01-30 07:42:18,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 158f3d84 >2014-01-30 07:42:18,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3449c195, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c48be317}, log id: 158f3d84 >2014-01-30 07:42:18,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2804b267 >2014-01-30 07:42:19,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2804b267 >2014-01-30 07:42:19,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 21e7a226 >2014-01-30 07:42:19,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21e7a226 >2014-01-30 07:42:24,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13123417 >2014-01-30 07:42:25,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 13123417 >2014-01-30 07:42:25,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56b5bb71 >2014-01-30 07:42:25,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3b0d4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0bfd4cb}, log id: 56b5bb71 >2014-01-30 07:42:25,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 39ae2126 >2014-01-30 07:42:25,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 39ae2126 >2014-01-30 07:42:25,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1909150b >2014-01-30 07:42:26,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1909150b >2014-01-30 07:42:31,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50998261 >2014-01-30 07:42:31,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 50998261 >2014-01-30 07:42:31,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41f1ce5c >2014-01-30 07:42:31,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7eec63e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad445baf}, log id: 41f1ce5c >2014-01-30 07:42:31,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6699dcb8 >2014-01-30 07:42:32,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6699dcb8 >2014-01-30 07:42:32,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1180c721 >2014-01-30 07:42:32,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1180c721 >2014-01-30 07:42:33,210 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-86) [63ec361] Start refreshing all users data >2014-01-30 07:42:33,261 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-57) [4166d263] Attempting to update VMs/Templates Ovf. >2014-01-30 07:42:37,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a3db4d9 >2014-01-30 07:42:38,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a3db4d9 >2014-01-30 07:42:38,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e6cdfe2 >2014-01-30 07:42:38,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ecd6f198, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ba65d1c}, log id: e6cdfe2 >2014-01-30 07:42:38,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4f71231e >2014-01-30 07:42:38,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4f71231e >2014-01-30 07:42:38,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 650d024c >2014-01-30 07:42:39,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 650d024c >2014-01-30 07:42:44,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 39e27177 >2014-01-30 07:42:44,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 39e27177 >2014-01-30 07:42:44,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54225e0e >2014-01-30 07:42:44,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d46178db, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70338c6}, log id: 54225e0e >2014-01-30 07:42:44,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3e12d7ce >2014-01-30 07:42:45,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3e12d7ce >2014-01-30 07:42:45,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 33072fd2 >2014-01-30 07:42:45,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33072fd2 >2014-01-30 07:42:50,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19421ad9 >2014-01-30 07:42:51,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 19421ad9 >2014-01-30 07:42:51,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d402a04 >2014-01-30 07:42:51,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@977296e3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8303db2b}, log id: d402a04 >2014-01-30 07:42:51,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 76aa8d8a >2014-01-30 07:42:51,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 76aa8d8a >2014-01-30 07:42:51,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4c2ca898 >2014-01-30 07:42:52,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c2ca898 >2014-01-30 07:42:57,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67a0ff54 >2014-01-30 07:42:57,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 67a0ff54 >2014-01-30 07:42:57,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7daa468b >2014-01-30 07:42:57,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eef7ef4e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccad69e1}, log id: 7daa468b >2014-01-30 07:42:58,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3692cb24 >2014-01-30 07:42:58,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3692cb24 >2014-01-30 07:42:58,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 50bce9d5 >2014-01-30 07:42:58,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 50bce9d5 >2014-01-30 07:43:03,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f2760b1 >2014-01-30 07:43:04,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f2760b1 >2014-01-30 07:43:04,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5de22579 >2014-01-30 07:43:04,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@deec961, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71e016fe}, log id: 5de22579 >2014-01-30 07:43:04,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3657df9d >2014-01-30 07:43:05,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3657df9d >2014-01-30 07:43:05,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: e99cc4e >2014-01-30 07:43:05,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e99cc4e >2014-01-30 07:43:10,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7fe8419f >2014-01-30 07:43:10,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7fe8419f >2014-01-30 07:43:10,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11e17328 >2014-01-30 07:43:11,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5547585, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5c42c68}, log id: 11e17328 >2014-01-30 07:43:11,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 399d37ee >2014-01-30 07:43:11,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 399d37ee >2014-01-30 07:43:11,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 757b87f4 >2014-01-30 07:43:11,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 757b87f4 >2014-01-30 07:43:15,170 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-2) [237643cb] No up server in cluster >2014-01-30 07:43:15,170 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-2) [237643cb] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:43:15,174 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-2) [237643cb] No up server in cluster >2014-01-30 07:43:15,174 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-2) [237643cb] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:43:15,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 4f859543 >2014-01-30 07:43:15,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4f859543 >2014-01-30 07:43:15,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 4596329e >2014-01-30 07:43:16,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterTasksListVDSCommand, return: [], log id: 4596329e >2014-01-30 07:43:16,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5edffd9 >2014-01-30 07:43:17,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5edffd9 >2014-01-30 07:43:17,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 75e2a9d5 >2014-01-30 07:43:17,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1226d95c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3440b20b}, log id: 75e2a9d5 >2014-01-30 07:43:17,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 75e04b4f >2014-01-30 07:43:18,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 75e04b4f >2014-01-30 07:43:18,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2f9b319d >2014-01-30 07:43:18,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f9b319d >2014-01-30 07:43:23,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 497a9365 >2014-01-30 07:43:23,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 497a9365 >2014-01-30 07:43:23,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54768b35 >2014-01-30 07:43:24,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b57a4a27, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b55a3a2a}, log id: 54768b35 >2014-01-30 07:43:24,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6428da51 >2014-01-30 07:43:24,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6428da51 >2014-01-30 07:43:24,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2435410a >2014-01-30 07:43:24,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2435410a >2014-01-30 07:43:29,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ff4052f >2014-01-30 07:43:30,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2ff4052f >2014-01-30 07:43:30,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46d42545 >2014-01-30 07:43:30,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a651b438, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc227ba2}, log id: 46d42545 >2014-01-30 07:43:30,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 72fd3bf8 >2014-01-30 07:43:31,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 72fd3bf8 >2014-01-30 07:43:31,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2975afab >2014-01-30 07:43:31,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2975afab >2014-01-30 07:43:36,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 289b01e1 >2014-01-30 07:43:37,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 289b01e1 >2014-01-30 07:43:37,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a14192d >2014-01-30 07:43:37,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@229737c5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@411ad287}, log id: a14192d >2014-01-30 07:43:37,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 302d3c0f >2014-01-30 07:43:37,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 302d3c0f >2014-01-30 07:43:37,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2f9ba5e0 >2014-01-30 07:43:38,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f9ba5e0 >2014-01-30 07:43:43,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 106e580b >2014-01-30 07:43:43,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 106e580b >2014-01-30 07:43:43,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 339b10ad >2014-01-30 07:43:43,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd6995d9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec9ce714}, log id: 339b10ad >2014-01-30 07:43:43,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 43eae0ca >2014-01-30 07:43:44,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 43eae0ca >2014-01-30 07:43:44,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 68678b75 >2014-01-30 07:43:44,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 68678b75 >2014-01-30 07:43:49,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1900605b >2014-01-30 07:43:50,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1900605b >2014-01-30 07:43:50,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41f35a6f >2014-01-30 07:43:50,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c6ed2fd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@703b513e}, log id: 41f35a6f >2014-01-30 07:43:50,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 72f9971d >2014-01-30 07:43:50,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 72f9971d >2014-01-30 07:43:50,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 307a45dd >2014-01-30 07:43:51,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 307a45dd >2014-01-30 07:43:56,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f26a797 >2014-01-30 07:43:56,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5f26a797 >2014-01-30 07:43:56,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d0bb49a >2014-01-30 07:43:57,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@819f6b36, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d9add1}, log id: 1d0bb49a >2014-01-30 07:43:57,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 74132280 >2014-01-30 07:43:57,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 74132280 >2014-01-30 07:43:57,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3cc9e6fe >2014-01-30 07:43:57,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3cc9e6fe >2014-01-30 07:44:02,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c6b05b1 >2014-01-30 07:44:03,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2c6b05b1 >2014-01-30 07:44:03,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 430c0808 >2014-01-30 07:44:03,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32ae356c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@503c3755}, log id: 430c0808 >2014-01-30 07:44:03,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d59d4fc >2014-01-30 07:44:04,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: d59d4fc >2014-01-30 07:44:04,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d439f5a >2014-01-30 07:44:04,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d439f5a >2014-01-30 07:44:09,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e37feb7 >2014-01-30 07:44:09,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: e37feb7 >2014-01-30 07:44:09,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e5410e6 >2014-01-30 07:44:10,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c32c0eda, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94121453}, log id: 5e5410e6 >2014-01-30 07:44:10,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 646b447e >2014-01-30 07:44:10,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 646b447e >2014-01-30 07:44:10,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 31e9f863 >2014-01-30 07:44:10,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 31e9f863 >2014-01-30 07:44:15,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5daf6632 >2014-01-30 07:44:16,009 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-21) [3dfe147] No up server in cluster >2014-01-30 07:44:16,009 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-21) [3dfe147] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:44:16,012 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-21) [3dfe147] No up server in cluster >2014-01-30 07:44:16,012 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-21) [3dfe147] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:44:16,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 484418bb >2014-01-30 07:44:16,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5daf6632 >2014-01-30 07:44:16,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11398a14 >2014-01-30 07:44:16,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 484418bb >2014-01-30 07:44:16,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5b7421ec >2014-01-30 07:44:16,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@789b03b4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f06d427c}, log id: 11398a14 >2014-01-30 07:44:16,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 147ecea1 >2014-01-30 07:44:16,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterTasksListVDSCommand, return: [], log id: 5b7421ec >2014-01-30 07:44:17,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 147ecea1 >2014-01-30 07:44:17,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b22774f >2014-01-30 07:44:17,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b22774f >2014-01-30 07:44:22,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 709301da >2014-01-30 07:44:22,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 709301da >2014-01-30 07:44:22,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56db7397 >2014-01-30 07:44:23,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@703c4ac3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd1a98ba}, log id: 56db7397 >2014-01-30 07:44:23,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 10590601 >2014-01-30 07:44:23,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 10590601 >2014-01-30 07:44:23,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: a07e960 >2014-01-30 07:44:23,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a07e960 >2014-01-30 07:44:28,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5604b3bc >2014-01-30 07:44:29,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5604b3bc >2014-01-30 07:44:29,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ecda1b3 >2014-01-30 07:44:29,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5ceb2d8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19f88368}, log id: 3ecda1b3 >2014-01-30 07:44:29,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5ef8ec5e >2014-01-30 07:44:30,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5ef8ec5e >2014-01-30 07:44:30,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6b8dae25 >2014-01-30 07:44:30,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6b8dae25 >2014-01-30 07:44:35,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 604fd379 >2014-01-30 07:44:36,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 604fd379 >2014-01-30 07:44:36,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 127bd7b1 >2014-01-30 07:44:36,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca3b1d84, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@986c1e79}, log id: 127bd7b1 >2014-01-30 07:44:36,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6fee1973 >2014-01-30 07:44:36,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6fee1973 >2014-01-30 07:44:36,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: e4e3c14 >2014-01-30 07:44:37,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e4e3c14 >2014-01-30 07:44:42,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5873b1c4 >2014-01-30 07:44:42,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5873b1c4 >2014-01-30 07:44:42,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3815c7e6 >2014-01-30 07:44:42,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8281015, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b03d202b}, log id: 3815c7e6 >2014-01-30 07:44:42,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5b80615f >2014-01-30 07:44:43,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5b80615f >2014-01-30 07:44:43,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5ef6afb >2014-01-30 07:44:43,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5ef6afb >2014-01-30 07:44:48,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26c12458 >2014-01-30 07:44:49,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 26c12458 >2014-01-30 07:44:49,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 755f377e >2014-01-30 07:44:49,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82c2d1fe, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4b15cd7}, log id: 755f377e >2014-01-30 07:44:49,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 741bbe03 >2014-01-30 07:44:49,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 741bbe03 >2014-01-30 07:44:49,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4fc6566e >2014-01-30 07:44:50,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fc6566e >2014-01-30 07:44:55,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d591de9 >2014-01-30 07:44:55,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1d591de9 >2014-01-30 07:44:55,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 47450dad >2014-01-30 07:44:56,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9bedf75, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41ff42f2}, log id: 47450dad >2014-01-30 07:44:56,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: a57f8d >2014-01-30 07:44:56,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: a57f8d >2014-01-30 07:44:56,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5891e5df >2014-01-30 07:44:56,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5891e5df >2014-01-30 07:45:01,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f2bb159 >2014-01-30 07:45:02,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4f2bb159 >2014-01-30 07:45:02,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68678ead >2014-01-30 07:45:02,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@972747c6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b1b7869}, log id: 68678ead >2014-01-30 07:45:02,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 44e20e16 >2014-01-30 07:45:03,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 44e20e16 >2014-01-30 07:45:03,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: a68654a >2014-01-30 07:45:03,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a68654a >2014-01-30 07:45:08,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54676769 >2014-01-30 07:45:08,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 54676769 >2014-01-30 07:45:08,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 339e7251 >2014-01-30 07:45:09,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b810b7bd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@925657b}, log id: 339e7251 >2014-01-30 07:45:09,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77b7d0ca >2014-01-30 07:45:09,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 77b7d0ca >2014-01-30 07:45:09,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 78db4067 >2014-01-30 07:45:09,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78db4067 >2014-01-30 07:45:14,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38738377 >2014-01-30 07:45:15,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 38738377 >2014-01-30 07:45:15,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 279ff33 >2014-01-30 07:45:15,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f8f9048, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38eed263}, log id: 279ff33 >2014-01-30 07:45:15,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 39afcac6 >2014-01-30 07:45:15,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a049e83 >2014-01-30 07:45:15,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@747ee754, log id: 3a049e83 >2014-01-30 07:45:15,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3785778c >2014-01-30 07:45:16,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 39afcac6 >2014-01-30 07:45:16,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 26985f1f >2014-01-30 07:45:16,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7fb217de, log id: 3785778c >2014-01-30 07:45:16,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26985f1f >2014-01-30 07:45:16,805 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-24) [3310e3f9] No up server in cluster >2014-01-30 07:45:16,806 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-24) [3310e3f9] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:45:16,810 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-24) [3310e3f9] No up server in cluster >2014-01-30 07:45:16,810 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-24) [3310e3f9] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:45:16,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 4fb889b9 >2014-01-30 07:45:17,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4fb889b9 >2014-01-30 07:45:17,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 72e938b9 >2014-01-30 07:45:17,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterTasksListVDSCommand, return: [], log id: 72e938b9 >2014-01-30 07:45:21,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49fc82cc >2014-01-30 07:45:21,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 49fc82cc >2014-01-30 07:45:21,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: daee568 >2014-01-30 07:45:22,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@87a7da7d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fc49b3e}, log id: daee568 >2014-01-30 07:45:22,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6d0519ff >2014-01-30 07:45:22,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6d0519ff >2014-01-30 07:45:22,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 75333e11 >2014-01-30 07:45:22,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 75333e11 >2014-01-30 07:45:27,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5876e218 >2014-01-30 07:45:28,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5876e218 >2014-01-30 07:45:28,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ebb72d6 >2014-01-30 07:45:28,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6260707f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb21be18}, log id: 1ebb72d6 >2014-01-30 07:45:28,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 50a95dde >2014-01-30 07:45:29,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 50a95dde >2014-01-30 07:45:29,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 80584c1 >2014-01-30 07:45:29,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 80584c1 >2014-01-30 07:45:34,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 391243ad >2014-01-30 07:45:34,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 391243ad >2014-01-30 07:45:35,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 575eff4d >2014-01-30 07:45:35,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d18b3a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e582a77a}, log id: 575eff4d >2014-01-30 07:45:35,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 766e99b7 >2014-01-30 07:45:35,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 766e99b7 >2014-01-30 07:45:35,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c3f9ea >2014-01-30 07:45:36,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c3f9ea >2014-01-30 07:45:41,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f93e2e7 >2014-01-30 07:45:41,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f93e2e7 >2014-01-30 07:45:41,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ca64b88 >2014-01-30 07:45:41,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@472db6ba, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b404adf7}, log id: 7ca64b88 >2014-01-30 07:45:41,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 408f1a80 >2014-01-30 07:45:42,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 408f1a80 >2014-01-30 07:45:42,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 146edfc8 >2014-01-30 07:45:42,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 146edfc8 >2014-01-30 07:45:47,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19049b88 >2014-01-30 07:45:48,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 19049b88 >2014-01-30 07:45:48,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56d6f834 >2014-01-30 07:45:48,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4c6294d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b6006b7}, log id: 56d6f834 >2014-01-30 07:45:48,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6b4e8762 >2014-01-30 07:45:48,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6b4e8762 >2014-01-30 07:45:48,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 337a5497 >2014-01-30 07:45:49,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 337a5497 >2014-01-30 07:45:54,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50a98595 >2014-01-30 07:45:54,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 50a98595 >2014-01-30 07:45:54,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 197df010 >2014-01-30 07:45:54,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1dd387f7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2b814a}, log id: 197df010 >2014-01-30 07:45:54,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 445a655d >2014-01-30 07:45:55,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 445a655d >2014-01-30 07:45:55,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 633d9153 >2014-01-30 07:45:55,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 633d9153 >2014-01-30 07:46:00,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 423a0cf7 >2014-01-30 07:46:01,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 423a0cf7 >2014-01-30 07:46:01,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c239dd >2014-01-30 07:46:01,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c3f6639, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cc6b16c}, log id: c239dd >2014-01-30 07:46:01,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2a560c85 >2014-01-30 07:46:01,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2a560c85 >2014-01-30 07:46:02,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 13da1751 >2014-01-30 07:46:02,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13da1751 >2014-01-30 07:46:07,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f802eaa >2014-01-30 07:46:07,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f802eaa >2014-01-30 07:46:07,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24585e4a >2014-01-30 07:46:08,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@59cbeb16, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d34adb6}, log id: 24585e4a >2014-01-30 07:46:08,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6333e4ae >2014-01-30 07:46:08,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6333e4ae >2014-01-30 07:46:08,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65276ca9 >2014-01-30 07:46:08,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65276ca9 >2014-01-30 07:46:13,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 34d2e8e8 >2014-01-30 07:46:14,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 34d2e8e8 >2014-01-30 07:46:14,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c4b86da >2014-01-30 07:46:14,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf5c701b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44a537c1}, log id: 4c4b86da >2014-01-30 07:46:14,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6608da1c >2014-01-30 07:46:15,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6608da1c >2014-01-30 07:46:15,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7bf0508 >2014-01-30 07:46:15,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7bf0508 >2014-01-30 07:46:17,620 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-74) [61851da7] No up server in cluster >2014-01-30 07:46:17,620 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-74) [61851da7] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:46:17,624 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-74) [61851da7] No up server in cluster >2014-01-30 07:46:17,624 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-74) [61851da7] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:46:17,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 49980421 >2014-01-30 07:46:18,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 49980421 >2014-01-30 07:46:18,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 910fa10 >2014-01-30 07:46:18,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterTasksListVDSCommand, return: [], log id: 910fa10 >2014-01-30 07:46:20,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9efacee >2014-01-30 07:46:20,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 9efacee >2014-01-30 07:46:20,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18ec2251 >2014-01-30 07:46:21,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55a27856, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce7522a9}, log id: 18ec2251 >2014-01-30 07:46:21,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2ba7f03b >2014-01-30 07:46:21,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2ba7f03b >2014-01-30 07:46:21,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 54291da5 >2014-01-30 07:46:21,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54291da5 >2014-01-30 07:46:26,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20182204 >2014-01-30 07:46:27,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 20182204 >2014-01-30 07:46:27,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 325fc3ea >2014-01-30 07:46:27,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5141d2ac, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed4e3a8a}, log id: 325fc3ea >2014-01-30 07:46:27,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 27c3718e >2014-01-30 07:46:28,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 27c3718e >2014-01-30 07:46:28,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2a7ed975 >2014-01-30 07:46:28,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2a7ed975 >2014-01-30 07:46:33,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fd14f23 >2014-01-30 07:46:33,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3fd14f23 >2014-01-30 07:46:33,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7640caac >2014-01-30 07:46:34,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbefd1b5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8eba2bfa}, log id: 7640caac >2014-01-30 07:46:34,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 35ae960e >2014-01-30 07:46:34,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 35ae960e >2014-01-30 07:46:34,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 35007335 >2014-01-30 07:46:35,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35007335 >2014-01-30 07:46:40,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d7e4ef7 >2014-01-30 07:46:40,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3d7e4ef7 >2014-01-30 07:46:40,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 325cabaf >2014-01-30 07:46:40,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41b43e7b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e06febed}, log id: 325cabaf >2014-01-30 07:46:40,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6c9088a6 >2014-01-30 07:46:41,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6c9088a6 >2014-01-30 07:46:41,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 36d2dce >2014-01-30 07:46:41,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 36d2dce >2014-01-30 07:46:46,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: bd84155 >2014-01-30 07:46:47,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: bd84155 >2014-01-30 07:46:47,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 555a913b >2014-01-30 07:46:47,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2bcb98e4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5c3845a}, log id: 555a913b >2014-01-30 07:46:47,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 466d89de >2014-01-30 07:46:47,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 466d89de >2014-01-30 07:46:47,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 73c4ed5e >2014-01-30 07:46:48,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73c4ed5e >2014-01-30 07:46:53,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b2cbff6 >2014-01-30 07:46:53,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b2cbff6 >2014-01-30 07:46:53,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: fd095f0 >2014-01-30 07:46:53,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5aa134e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e226ddb}, log id: fd095f0 >2014-01-30 07:46:54,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a54e581 >2014-01-30 07:46:54,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7a54e581 >2014-01-30 07:46:54,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 71fc0e95 >2014-01-30 07:46:54,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 71fc0e95 >2014-01-30 07:46:59,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72cd9c09 >2014-01-30 07:47:00,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 72cd9c09 >2014-01-30 07:47:00,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a51757c >2014-01-30 07:47:00,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb9740c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@babbc6e3}, log id: a51757c >2014-01-30 07:47:00,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 266a96af >2014-01-30 07:47:01,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 266a96af >2014-01-30 07:47:01,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 60835d91 >2014-01-30 07:47:01,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60835d91 >2014-01-30 07:47:06,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3cfc0743 >2014-01-30 07:47:06,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3cfc0743 >2014-01-30 07:47:06,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 57fdfaef >2014-01-30 07:47:07,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b733f4f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aedff06d}, log id: 57fdfaef >2014-01-30 07:47:07,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1010d46d >2014-01-30 07:47:07,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1010d46d >2014-01-30 07:47:07,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6839d460 >2014-01-30 07:47:07,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6839d460 >2014-01-30 07:47:12,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b5a9feb >2014-01-30 07:47:13,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: b5a9feb >2014-01-30 07:47:13,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42bbe000 >2014-01-30 07:47:13,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54e9cd6a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6deba13d}, log id: 42bbe000 >2014-01-30 07:47:13,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7e49be40 >2014-01-30 07:47:14,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7e49be40 >2014-01-30 07:47:14,150 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3a319ada >2014-01-30 07:47:14,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a319ada >2014-01-30 07:47:18,460 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-71) [1ac2212e] No up server in cluster >2014-01-30 07:47:18,460 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-71) [1ac2212e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:47:18,462 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-71) [1ac2212e] No up server in cluster >2014-01-30 07:47:18,462 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-71) [1ac2212e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:47:18,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 60cf2802 >2014-01-30 07:47:19,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 60cf2802 >2014-01-30 07:47:19,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 27764067 >2014-01-30 07:47:19,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterTasksListVDSCommand, return: [], log id: 27764067 >2014-01-30 07:47:19,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 92c0ee4 >2014-01-30 07:47:19,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 92c0ee4 >2014-01-30 07:47:19,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1fdae18d >2014-01-30 07:47:20,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af20ffce, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8708416}, log id: 1fdae18d >2014-01-30 07:47:20,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 186abc95 >2014-01-30 07:47:20,742 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 186abc95 >2014-01-30 07:47:20,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2c5391b7 >2014-01-30 07:47:21,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c5391b7 >2014-01-30 07:47:26,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2513ae9c >2014-01-30 07:47:26,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2513ae9c >2014-01-30 07:47:26,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d88b032 >2014-01-30 07:47:26,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e8da9e2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6807bf6a}, log id: 3d88b032 >2014-01-30 07:47:26,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: f5386a0 >2014-01-30 07:47:27,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: f5386a0 >2014-01-30 07:47:27,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ccafcc7 >2014-01-30 07:47:27,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ccafcc7 >2014-01-30 07:47:32,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53f6fa1c >2014-01-30 07:47:33,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 53f6fa1c >2014-01-30 07:47:33,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f6fc81c >2014-01-30 07:47:33,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3c7c572, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17db4649}, log id: 5f6fc81c >2014-01-30 07:47:33,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ab0bde0 >2014-01-30 07:47:33,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6ab0bde0 >2014-01-30 07:47:33,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 62170125 >2014-01-30 07:47:34,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62170125 >2014-01-30 07:47:39,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3dd9c2aa >2014-01-30 07:47:39,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3dd9c2aa >2014-01-30 07:47:39,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 251ac9ce >2014-01-30 07:47:39,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a86471c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f55d475}, log id: 251ac9ce >2014-01-30 07:47:40,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7f728e0a >2014-01-30 07:47:40,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7f728e0a >2014-01-30 07:47:40,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 181b7338 >2014-01-30 07:47:40,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 181b7338 >2014-01-30 07:47:45,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f8faf37 >2014-01-30 07:47:46,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5f8faf37 >2014-01-30 07:47:46,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58f98ef9 >2014-01-30 07:47:46,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24f6525, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae1fdb4a}, log id: 58f98ef9 >2014-01-30 07:47:46,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 10452837 >2014-01-30 07:47:47,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 10452837 >2014-01-30 07:47:47,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5cdf1915 >2014-01-30 07:47:47,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5cdf1915 >2014-01-30 07:47:52,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 179a2ed8 >2014-01-30 07:47:52,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 179a2ed8 >2014-01-30 07:47:52,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53f077e3 >2014-01-30 07:47:53,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b951a92, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df95efd1}, log id: 53f077e3 >2014-01-30 07:47:53,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 43c4fe3d >2014-01-30 07:47:53,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 43c4fe3d >2014-01-30 07:47:53,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 54f405de >2014-01-30 07:47:53,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54f405de >2014-01-30 07:47:58,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54b8572e >2014-01-30 07:47:59,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 54b8572e >2014-01-30 07:47:59,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20916136 >2014-01-30 07:47:59,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b1ee096, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@887b8d8b}, log id: 20916136 >2014-01-30 07:47:59,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 35f3c684 >2014-01-30 07:48:00,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 35f3c684 >2014-01-30 07:48:00,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 446a8a69 >2014-01-30 07:48:00,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 446a8a69 >2014-01-30 07:48:05,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 648e2f3 >2014-01-30 07:48:05,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 648e2f3 >2014-01-30 07:48:05,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fe460a2 >2014-01-30 07:48:06,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@503f1289, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9677e233}, log id: 3fe460a2 >2014-01-30 07:48:06,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4ff9015f >2014-01-30 07:48:06,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4ff9015f >2014-01-30 07:48:06,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 323aa436 >2014-01-30 07:48:06,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 323aa436 >2014-01-30 07:48:11,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32175ab2 >2014-01-30 07:48:12,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 32175ab2 >2014-01-30 07:48:12,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a08ede0 >2014-01-30 07:48:12,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f9e9d6c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8299a462}, log id: 3a08ede0 >2014-01-30 07:48:12,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 220b74d0 >2014-01-30 07:48:13,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 220b74d0 >2014-01-30 07:48:13,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e0d9ed7 >2014-01-30 07:48:13,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e0d9ed7 >2014-01-30 07:48:18,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51d046b7 >2014-01-30 07:48:19,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 51d046b7 >2014-01-30 07:48:19,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64ffd8e7 >2014-01-30 07:48:19,300 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] No up server in cluster >2014-01-30 07:48:19,300 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:48:19,303 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] No up server in cluster >2014-01-30 07:48:19,303 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:48:19,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: f512fbd >2014-01-30 07:48:19,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1b9ea2b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a3205e4}, log id: 64ffd8e7 >2014-01-30 07:48:19,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c891a1c >2014-01-30 07:48:19,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5c891a1c >2014-01-30 07:48:19,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2ea57618 >2014-01-30 07:48:19,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: f512fbd >2014-01-30 07:48:19,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 7b52ea77 >2014-01-30 07:48:20,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ea57618 >2014-01-30 07:48:20,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterTasksListVDSCommand, return: [], log id: 7b52ea77 >2014-01-30 07:48:25,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 256e9e1b >2014-01-30 07:48:25,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 256e9e1b >2014-01-30 07:48:25,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6253bac1 >2014-01-30 07:48:25,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f6fa876, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3eb6f821}, log id: 6253bac1 >2014-01-30 07:48:25,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 52ae24cc >2014-01-30 07:48:26,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 52ae24cc >2014-01-30 07:48:26,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4aec1978 >2014-01-30 07:48:26,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4aec1978 >2014-01-30 07:48:31,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e1fb3a >2014-01-30 07:48:32,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e1fb3a >2014-01-30 07:48:32,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d35db0d >2014-01-30 07:48:32,420 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ac5b04c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@977ef}, log id: d35db0d >2014-01-30 07:48:32,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7ac20687 >2014-01-30 07:48:32,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7ac20687 >2014-01-30 07:48:32,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 719dfffe >2014-01-30 07:48:33,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 719dfffe >2014-01-30 07:48:38,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a355be4 >2014-01-30 07:48:38,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5a355be4 >2014-01-30 07:48:38,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7649ee56 >2014-01-30 07:48:38,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@701515dd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@800f7269}, log id: 7649ee56 >2014-01-30 07:48:38,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6114d0e5 >2014-01-30 07:48:39,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6114d0e5 >2014-01-30 07:48:39,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 26f82905 >2014-01-30 07:48:39,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 26f82905 >2014-01-30 07:48:44,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71e65dd1 >2014-01-30 07:48:45,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 71e65dd1 >2014-01-30 07:48:45,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24be1d35 >2014-01-30 07:48:45,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68234f96, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e341146f}, log id: 24be1d35 >2014-01-30 07:48:45,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 47e0baad >2014-01-30 07:48:46,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 47e0baad >2014-01-30 07:48:46,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7910f6ca >2014-01-30 07:48:46,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7910f6ca >2014-01-30 07:48:51,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a8519ec >2014-01-30 07:48:51,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4a8519ec >2014-01-30 07:48:51,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 70f1095f >2014-01-30 07:48:52,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d70dac5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4b3f9c6}, log id: 70f1095f >2014-01-30 07:48:52,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 31200e3e >2014-01-30 07:48:52,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 31200e3e >2014-01-30 07:48:52,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5f8e9ff2 >2014-01-30 07:48:52,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5f8e9ff2 >2014-01-30 07:48:57,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22027baf >2014-01-30 07:48:58,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 22027baf >2014-01-30 07:48:58,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ee0dcde >2014-01-30 07:48:58,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b622485d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ea59196}, log id: 2ee0dcde >2014-01-30 07:48:58,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5e7a9df5 >2014-01-30 07:48:59,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5e7a9df5 >2014-01-30 07:48:59,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2f39005c >2014-01-30 07:48:59,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2f39005c >2014-01-30 07:49:04,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6cb7b78b >2014-01-30 07:49:04,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6cb7b78b >2014-01-30 07:49:04,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 691248be >2014-01-30 07:49:05,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e435ea84, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66e73945}, log id: 691248be >2014-01-30 07:49:05,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6cafe929 >2014-01-30 07:49:05,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6cafe929 >2014-01-30 07:49:05,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 43689523 >2014-01-30 07:49:05,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 43689523 >2014-01-30 07:49:11,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3368bbec >2014-01-30 07:49:11,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3368bbec >2014-01-30 07:49:11,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1da310c2 >2014-01-30 07:49:11,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88fd09a1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73d3cd52}, log id: 1da310c2 >2014-01-30 07:49:11,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 36f113b3 >2014-01-30 07:49:12,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 36f113b3 >2014-01-30 07:49:12,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 51d83fe1 >2014-01-30 07:49:12,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 51d83fe1 >2014-01-30 07:49:17,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e24857b >2014-01-30 07:49:18,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6e24857b >2014-01-30 07:49:18,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33a5260a >2014-01-30 07:49:18,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22760ab1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba88e467}, log id: 33a5260a >2014-01-30 07:49:18,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7cba03b9 >2014-01-30 07:49:18,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7cba03b9 >2014-01-30 07:49:18,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7607b64 >2014-01-30 07:49:19,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7607b64 >2014-01-30 07:49:20,081 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-96) [444c158d] No up server in cluster >2014-01-30 07:49:20,082 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-96) [444c158d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:49:20,084 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-96) [444c158d] No up server in cluster >2014-01-30 07:49:20,084 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-96) [444c158d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:49:20,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: ef81a29 >2014-01-30 07:49:20,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: ef81a29 >2014-01-30 07:49:20,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 637512b7 >2014-01-30 07:49:20,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterTasksListVDSCommand, return: [], log id: 637512b7 >2014-01-30 07:49:24,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f692b44 >2014-01-30 07:49:24,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f692b44 >2014-01-30 07:49:24,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 140137a6 >2014-01-30 07:49:24,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66dabb81, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12902912}, log id: 140137a6 >2014-01-30 07:49:24,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 70047660 >2014-01-30 07:49:25,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 70047660 >2014-01-30 07:49:25,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 58dcd550 >2014-01-30 07:49:25,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58dcd550 >2014-01-30 07:49:30,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72ca54a7 >2014-01-30 07:49:31,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 72ca54a7 >2014-01-30 07:49:31,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9d64d3f >2014-01-30 07:49:31,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@443a77c8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd1e6878}, log id: 9d64d3f >2014-01-30 07:49:31,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 72e5f0b1 >2014-01-30 07:49:32,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 72e5f0b1 >2014-01-30 07:49:32,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7b15b3e4 >2014-01-30 07:49:32,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7b15b3e4 >2014-01-30 07:49:37,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e5eccde >2014-01-30 07:49:37,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e5eccde >2014-01-30 07:49:37,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 47742b61 >2014-01-30 07:49:38,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23c298c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d03691a2}, log id: 47742b61 >2014-01-30 07:49:38,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 59d4c04c >2014-01-30 07:49:38,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 59d4c04c >2014-01-30 07:49:38,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 16e4b546 >2014-01-30 07:49:38,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16e4b546 >2014-01-30 07:49:43,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 470a1487 >2014-01-30 07:49:44,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 470a1487 >2014-01-30 07:49:44,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48f0de02 >2014-01-30 07:49:44,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7aab2832, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c27d50b8}, log id: 48f0de02 >2014-01-30 07:49:44,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 31992e5 >2014-01-30 07:49:45,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 31992e5 >2014-01-30 07:49:45,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65968250 >2014-01-30 07:49:45,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65968250 >2014-01-30 07:49:50,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2136045d >2014-01-30 07:49:50,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2136045d >2014-01-30 07:49:50,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37fbb5ee >2014-01-30 07:49:51,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b970b4c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd044b3a}, log id: 37fbb5ee >2014-01-30 07:49:51,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65113c15 >2014-01-30 07:49:51,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 65113c15 >2014-01-30 07:49:51,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4a0aeda7 >2014-01-30 07:49:51,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4a0aeda7 >2014-01-30 07:49:56,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 712c31aa >2014-01-30 07:49:57,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 712c31aa >2014-01-30 07:49:57,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6101dfcc >2014-01-30 07:49:57,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1eef618, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c95c2e78}, log id: 6101dfcc >2014-01-30 07:49:57,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: a4f86cd >2014-01-30 07:49:58,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: a4f86cd >2014-01-30 07:49:58,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 8b0ad14 >2014-01-30 07:49:58,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 8b0ad14 >2014-01-30 07:50:03,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2df10957 >2014-01-30 07:50:04,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2df10957 >2014-01-30 07:50:04,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74b30b03 >2014-01-30 07:50:04,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9edb14e1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad0f6aa0}, log id: 74b30b03 >2014-01-30 07:50:04,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 515a6a3a >2014-01-30 07:50:04,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 515a6a3a >2014-01-30 07:50:04,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 629278d1 >2014-01-30 07:50:05,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 629278d1 >2014-01-30 07:50:10,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 678b5c46 >2014-01-30 07:50:10,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 678b5c46 >2014-01-30 07:50:10,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 156095a0 >2014-01-30 07:50:10,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fe7b50d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcd03154}, log id: 156095a0 >2014-01-30 07:50:10,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 513a91f6 >2014-01-30 07:50:11,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 513a91f6 >2014-01-30 07:50:11,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5b92d0b8 >2014-01-30 07:50:11,646 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b92d0b8 >2014-01-30 07:50:16,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 32ce5daf >2014-01-30 07:50:16,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@bed086e, log id: 32ce5daf >2014-01-30 07:50:16,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 76c473df >2014-01-30 07:50:16,662 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-59) [499ce58b] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 07:50:16,729 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-59) [499ce58b] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 07:50:16,731 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-59) [499ce58b] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 07:50:16,771 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-59) [499ce58b] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 07:50:16,802 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-59) [499ce58b] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 07:50:16,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@509520b2, log id: 76c473df >2014-01-30 07:50:16,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e95af72 >2014-01-30 07:50:17,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6e95af72 >2014-01-30 07:50:17,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6fdfd276 >2014-01-30 07:50:17,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b73cded3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca843dcd}, log id: 6fdfd276 >2014-01-30 07:50:17,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3d2848a9 >2014-01-30 07:50:18,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3d2848a9 >2014-01-30 07:50:18,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5aae500d >2014-01-30 07:50:18,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5aae500d >2014-01-30 07:50:20,952 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] No up server in cluster >2014-01-30 07:50:20,952 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:50:20,955 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] No up server in cluster >2014-01-30 07:50:20,955 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:50:20,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 5f494048 >2014-01-30 07:50:21,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 5f494048 >2014-01-30 07:50:21,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 22cc66ad >2014-01-30 07:50:21,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterTasksListVDSCommand, return: [], log id: 22cc66ad >2014-01-30 07:50:23,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a074d83 >2014-01-30 07:50:23,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2a074d83 >2014-01-30 07:50:23,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c95d4fa >2014-01-30 07:50:24,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a5b7446, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fb4b962}, log id: 7c95d4fa >2014-01-30 07:50:24,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1e8343d5 >2014-01-30 07:50:24,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1e8343d5 >2014-01-30 07:50:24,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4e83dd56 >2014-01-30 07:50:24,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4e83dd56 >2014-01-30 07:50:29,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a4e50f7 >2014-01-30 07:50:30,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7a4e50f7 >2014-01-30 07:50:30,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ab19a21 >2014-01-30 07:50:30,777 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6cdb7e15, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5f0b9c4}, log id: 7ab19a21 >2014-01-30 07:50:30,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5a9a8308 >2014-01-30 07:50:31,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5a9a8308 >2014-01-30 07:50:31,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: a1d433f >2014-01-30 07:50:31,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: a1d433f >2014-01-30 07:50:36,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10dade0d >2014-01-30 07:50:37,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 10dade0d >2014-01-30 07:50:37,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72bef6a4 >2014-01-30 07:50:37,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3f82e04, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5045e67a}, log id: 72bef6a4 >2014-01-30 07:50:37,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4d61e83a >2014-01-30 07:50:37,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4d61e83a >2014-01-30 07:50:37,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 518fef63 >2014-01-30 07:50:38,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 518fef63 >2014-01-30 07:50:43,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c40aba2 >2014-01-30 07:50:43,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3c40aba2 >2014-01-30 07:50:43,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 612f2b45 >2014-01-30 07:50:43,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3031e36, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e71ed7}, log id: 612f2b45 >2014-01-30 07:50:43,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 705d282a >2014-01-30 07:50:44,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 705d282a >2014-01-30 07:50:44,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2ec39cfc >2014-01-30 07:50:44,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ec39cfc >2014-01-30 07:50:49,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f6ddc17 >2014-01-30 07:50:50,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: f6ddc17 >2014-01-30 07:50:50,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1dc50faf >2014-01-30 07:50:50,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@557e99c3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@68426a86}, log id: 1dc50faf >2014-01-30 07:50:50,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6a952539 >2014-01-30 07:50:50,917 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6a952539 >2014-01-30 07:50:50,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1e94516d >2014-01-30 07:50:51,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1e94516d >2014-01-30 07:50:56,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b60d90a >2014-01-30 07:50:56,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b60d90a >2014-01-30 07:50:56,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e2d38dc >2014-01-30 07:50:56,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80f10512, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6737ba37}, log id: 7e2d38dc >2014-01-30 07:50:56,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3fe84f5a >2014-01-30 07:50:57,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3fe84f5a >2014-01-30 07:50:57,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 418123a3 >2014-01-30 07:50:57,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 418123a3 >2014-01-30 07:51:02,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9621e19 >2014-01-30 07:51:03,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 9621e19 >2014-01-30 07:51:03,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66abe81c >2014-01-30 07:51:03,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1656db1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f841a9c1}, log id: 66abe81c >2014-01-30 07:51:03,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1bf59be4 >2014-01-30 07:51:04,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1bf59be4 >2014-01-30 07:51:04,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 33819e22 >2014-01-30 07:51:04,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 33819e22 >2014-01-30 07:51:09,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4733cbb8 >2014-01-30 07:51:09,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4733cbb8 >2014-01-30 07:51:09,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50314c5e >2014-01-30 07:51:10,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78f67ece, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a37917d0}, log id: 50314c5e >2014-01-30 07:51:10,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77e2cd67 >2014-01-30 07:51:10,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 77e2cd67 >2014-01-30 07:51:10,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 177dd90 >2014-01-30 07:51:10,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 177dd90 >2014-01-30 07:51:15,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23b0750 >2014-01-30 07:51:16,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 23b0750 >2014-01-30 07:51:16,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 192fb084 >2014-01-30 07:51:16,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a2169d8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d32f05f2}, log id: 192fb084 >2014-01-30 07:51:16,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7386ece8 >2014-01-30 07:51:17,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7386ece8 >2014-01-30 07:51:17,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: efc6b2f >2014-01-30 07:51:17,262 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: efc6b2f >2014-01-30 07:51:21,783 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) [79e57d6f] No up server in cluster >2014-01-30 07:51:21,783 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:51:21,787 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) [79e57d6f] No up server in cluster >2014-01-30 07:51:21,787 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:51:21,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 539f140c >2014-01-30 07:51:22,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 570f321c >2014-01-30 07:51:22,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 539f140c >2014-01-30 07:51:22,343 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: b17b169 >2014-01-30 07:51:22,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterTasksListVDSCommand, return: [], log id: b17b169 >2014-01-30 07:51:22,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 570f321c >2014-01-30 07:51:22,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38164f4a >2014-01-30 07:51:23,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d27b3dbe, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ef13666}, log id: 38164f4a >2014-01-30 07:51:23,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 328c4a31 >2014-01-30 07:51:23,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 328c4a31 >2014-01-30 07:51:23,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 44154173 >2014-01-30 07:51:23,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44154173 >2014-01-30 07:51:28,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66200c71 >2014-01-30 07:51:29,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 66200c71 >2014-01-30 07:51:29,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54c2fb58 >2014-01-30 07:51:29,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b736c2f3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f54e45}, log id: 54c2fb58 >2014-01-30 07:51:29,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7ffa7358 >2014-01-30 07:51:30,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7ffa7358 >2014-01-30 07:51:30,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2c20e5e5 >2014-01-30 07:51:30,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c20e5e5 >2014-01-30 07:51:35,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5af9b22b >2014-01-30 07:51:35,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5af9b22b >2014-01-30 07:51:35,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79439c61 >2014-01-30 07:51:36,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ad3d658, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44d2473b}, log id: 79439c61 >2014-01-30 07:51:36,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1f30042b >2014-01-30 07:51:36,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1f30042b >2014-01-30 07:51:36,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 67348760 >2014-01-30 07:51:36,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67348760 >2014-01-30 07:51:41,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e20f557 >2014-01-30 07:51:42,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3e20f557 >2014-01-30 07:51:42,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c6d982a >2014-01-30 07:51:42,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0e027d6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffda7c7a}, log id: 2c6d982a >2014-01-30 07:51:42,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2c3a646c >2014-01-30 07:51:43,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2c3a646c >2014-01-30 07:51:43,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 15ae8723 >2014-01-30 07:51:43,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15ae8723 >2014-01-30 07:51:48,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31cbd103 >2014-01-30 07:51:49,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 31cbd103 >2014-01-30 07:51:49,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58b120 >2014-01-30 07:51:49,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d93b215, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29b40afc}, log id: 58b120 >2014-01-30 07:51:49,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 275ac133 >2014-01-30 07:51:49,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 275ac133 >2014-01-30 07:51:49,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5fc5b58e >2014-01-30 07:51:50,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5fc5b58e >2014-01-30 07:51:55,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3bf48931 >2014-01-30 07:51:55,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3bf48931 >2014-01-30 07:51:55,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 794ab2ee >2014-01-30 07:51:55,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49315ab0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c746d744}, log id: 794ab2ee >2014-01-30 07:51:55,940 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 10427d3d >2014-01-30 07:51:56,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 10427d3d >2014-01-30 07:51:56,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2e62012 >2014-01-30 07:51:56,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e62012 >2014-01-30 07:52:01,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66d328a4 >2014-01-30 07:52:02,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 66d328a4 >2014-01-30 07:52:02,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32c84b05 >2014-01-30 07:52:02,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8769977, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64e6c89a}, log id: 32c84b05 >2014-01-30 07:52:02,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5750eb7f >2014-01-30 07:52:02,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5750eb7f >2014-01-30 07:52:03,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5d9ebbb >2014-01-30 07:52:03,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5d9ebbb >2014-01-30 07:52:08,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3acc6412 >2014-01-30 07:52:08,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3acc6412 >2014-01-30 07:52:08,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7323f9b5 >2014-01-30 07:52:09,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0e8f850, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@432c074a}, log id: 7323f9b5 >2014-01-30 07:52:09,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 24d53186 >2014-01-30 07:52:09,568 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 24d53186 >2014-01-30 07:52:09,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: f2b63bd >2014-01-30 07:52:09,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f2b63bd >2014-01-30 07:52:14,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 753ee0f9 >2014-01-30 07:52:15,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 753ee0f9 >2014-01-30 07:52:15,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 426dfc50 >2014-01-30 07:52:15,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7d31348, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61ec33b4}, log id: 426dfc50 >2014-01-30 07:52:15,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6eaa3902 >2014-01-30 07:52:16,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6eaa3902 >2014-01-30 07:52:16,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4ccf3c6b >2014-01-30 07:52:16,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ccf3c6b >2014-01-30 07:52:21,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e50b21b >2014-01-30 07:52:21,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4e50b21b >2014-01-30 07:52:21,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68bffec6 >2014-01-30 07:52:22,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f79ee51f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f1b0959}, log id: 68bffec6 >2014-01-30 07:52:22,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6106c7ba >2014-01-30 07:52:22,577 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) [70a1c224] No up server in cluster >2014-01-30 07:52:22,577 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) [70a1c224] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:52:22,580 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-8) [70a1c224] No up server in cluster >2014-01-30 07:52:22,580 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-8) [70a1c224] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:52:22,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f2175e4 >2014-01-30 07:52:22,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6106c7ba >2014-01-30 07:52:22,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 610585a2 >2014-01-30 07:52:22,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 610585a2 >2014-01-30 07:52:23,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 2f2175e4 >2014-01-30 07:52:23,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 1d1db960 >2014-01-30 07:52:23,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterTasksListVDSCommand, return: [], log id: 1d1db960 >2014-01-30 07:52:27,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10db7d9a >2014-01-30 07:52:28,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 10db7d9a >2014-01-30 07:52:28,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e381dc >2014-01-30 07:52:28,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a62bd84b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cdc0f0f}, log id: 5e381dc >2014-01-30 07:52:28,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7f99cc4c >2014-01-30 07:52:29,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7f99cc4c >2014-01-30 07:52:29,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 74682022 >2014-01-30 07:52:29,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74682022 >2014-01-30 07:52:34,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41c2313e >2014-01-30 07:52:34,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 41c2313e >2014-01-30 07:52:34,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40eb0d61 >2014-01-30 07:52:35,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de8122c4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd76574a}, log id: 40eb0d61 >2014-01-30 07:52:35,290 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 63c9ea4a >2014-01-30 07:52:35,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 63c9ea4a >2014-01-30 07:52:35,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 38a11a04 >2014-01-30 07:52:36,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38a11a04 >2014-01-30 07:52:41,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d4f951a >2014-01-30 07:52:41,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: d4f951a >2014-01-30 07:52:41,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c6b21a3 >2014-01-30 07:52:41,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83fe5e21, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee0527b1}, log id: 4c6b21a3 >2014-01-30 07:52:41,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 11972a41 >2014-01-30 07:52:42,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 11972a41 >2014-01-30 07:52:42,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d90a34e >2014-01-30 07:52:42,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: d90a34e >2014-01-30 07:52:47,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 144a09b9 >2014-01-30 07:52:48,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 144a09b9 >2014-01-30 07:52:48,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7707bc99 >2014-01-30 07:52:48,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1051afb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f57b9272}, log id: 7707bc99 >2014-01-30 07:52:48,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5b041bd2 >2014-01-30 07:52:48,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5b041bd2 >2014-01-30 07:52:48,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 73cf2ff0 >2014-01-30 07:52:49,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73cf2ff0 >2014-01-30 07:52:54,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4690ad74 >2014-01-30 07:52:54,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4690ad74 >2014-01-30 07:52:54,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36888c7d >2014-01-30 07:52:54,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ff8898c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5df30e03}, log id: 36888c7d >2014-01-30 07:52:55,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 60e6d1c2 >2014-01-30 07:52:55,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 60e6d1c2 >2014-01-30 07:52:55,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 298ee15b >2014-01-30 07:52:55,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 298ee15b >2014-01-30 07:53:00,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2559a69e >2014-01-30 07:53:01,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2559a69e >2014-01-30 07:53:01,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78f7f6be >2014-01-30 07:53:01,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e73e24b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f636e47f}, log id: 78f7f6be >2014-01-30 07:53:01,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 63a67835 >2014-01-30 07:53:02,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 63a67835 >2014-01-30 07:53:02,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 150b7056 >2014-01-30 07:53:02,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 150b7056 >2014-01-30 07:53:07,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 45291174 >2014-01-30 07:53:07,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 45291174 >2014-01-30 07:53:07,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7baa23f2 >2014-01-30 07:53:08,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5e16d8a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62b2595b}, log id: 7baa23f2 >2014-01-30 07:53:08,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 786c169c >2014-01-30 07:53:08,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 786c169c >2014-01-30 07:53:08,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6716730 >2014-01-30 07:53:08,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6716730 >2014-01-30 07:53:13,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c696c1c >2014-01-30 07:53:14,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2c696c1c >2014-01-30 07:53:14,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7569625f >2014-01-30 07:53:14,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16bdaafa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d54c0d69}, log id: 7569625f >2014-01-30 07:53:14,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 40e8165a >2014-01-30 07:53:15,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 40e8165a >2014-01-30 07:53:15,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: eed2693 >2014-01-30 07:53:15,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: eed2693 >2014-01-30 07:53:20,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1dea261b >2014-01-30 07:53:20,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1dea261b >2014-01-30 07:53:20,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 609df37e >2014-01-30 07:53:21,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@330814be, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aacb2ca8}, log id: 609df37e >2014-01-30 07:53:21,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1bd60ddc >2014-01-30 07:53:21,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1bd60ddc >2014-01-30 07:53:21,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4734c924 >2014-01-30 07:53:21,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4734c924 >2014-01-30 07:53:23,370 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-65) [227486be] No up server in cluster >2014-01-30 07:53:23,370 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-65) [227486be] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:53:23,374 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-65) [227486be] No up server in cluster >2014-01-30 07:53:23,374 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-65) [227486be] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:53:23,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 5cd20ecd >2014-01-30 07:53:23,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 5cd20ecd >2014-01-30 07:53:23,931 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 55cff691 >2014-01-30 07:53:24,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterTasksListVDSCommand, return: [], log id: 55cff691 >2014-01-30 07:53:26,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e51d76f >2014-01-30 07:53:27,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7e51d76f >2014-01-30 07:53:27,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 723b1628 >2014-01-30 07:53:27,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a51e00af, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@917923be}, log id: 723b1628 >2014-01-30 07:53:27,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 67e80873 >2014-01-30 07:53:28,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 67e80873 >2014-01-30 07:53:28,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3ea2738a >2014-01-30 07:53:28,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3ea2738a >2014-01-30 07:53:33,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22a9fb5 >2014-01-30 07:53:33,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 22a9fb5 >2014-01-30 07:53:33,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f0a7685 >2014-01-30 07:53:34,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8f717f3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db5e7352}, log id: 3f0a7685 >2014-01-30 07:53:34,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 688e5674 >2014-01-30 07:53:34,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 688e5674 >2014-01-30 07:53:34,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c341f26 >2014-01-30 07:53:35,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c341f26 >2014-01-30 07:53:40,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a03f518 >2014-01-30 07:53:40,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2a03f518 >2014-01-30 07:53:40,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51c59445 >2014-01-30 07:53:40,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d37a6857, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a50a5c8}, log id: 51c59445 >2014-01-30 07:53:40,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 76a50a4d >2014-01-30 07:53:41,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 76a50a4d >2014-01-30 07:53:41,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1706c42f >2014-01-30 07:53:41,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1706c42f >2014-01-30 07:53:46,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 673701a6 >2014-01-30 07:53:47,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 673701a6 >2014-01-30 07:53:47,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c366492 >2014-01-30 07:53:47,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a5d1cc5d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ac0eb56}, log id: 6c366492 >2014-01-30 07:53:47,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 412f3e7d >2014-01-30 07:53:47,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 412f3e7d >2014-01-30 07:53:47,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 23ce7be1 >2014-01-30 07:53:48,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 23ce7be1 >2014-01-30 07:53:53,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33c5ec20 >2014-01-30 07:53:53,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 33c5ec20 >2014-01-30 07:53:53,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76930dc9 >2014-01-30 07:53:53,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9884c9bd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8fe8fb}, log id: 76930dc9 >2014-01-30 07:53:53,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4017e31c >2014-01-30 07:53:54,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4017e31c >2014-01-30 07:53:54,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 24e07023 >2014-01-30 07:53:54,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24e07023 >2014-01-30 07:53:59,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30284577 >2014-01-30 07:54:00,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 30284577 >2014-01-30 07:54:00,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6895feba >2014-01-30 07:54:00,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cff3fdf0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a38f62e}, log id: 6895feba >2014-01-30 07:54:00,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 774929fd >2014-01-30 07:54:00,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 774929fd >2014-01-30 07:54:00,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b12b42e >2014-01-30 07:54:01,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b12b42e >2014-01-30 07:54:06,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74887b4a >2014-01-30 07:54:06,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 74887b4a >2014-01-30 07:54:06,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b60366a >2014-01-30 07:54:06,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3643864b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9d4c890}, log id: 2b60366a >2014-01-30 07:54:06,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 131233cf >2014-01-30 07:54:07,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 131233cf >2014-01-30 07:54:07,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 72fb4bf2 >2014-01-30 07:54:07,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 72fb4bf2 >2014-01-30 07:54:12,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 522bbab0 >2014-01-30 07:54:13,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 522bbab0 >2014-01-30 07:54:13,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 70fc6540 >2014-01-30 07:54:13,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6fa5aa9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8589019e}, log id: 70fc6540 >2014-01-30 07:54:13,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1fb129f8 >2014-01-30 07:54:14,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1fb129f8 >2014-01-30 07:54:14,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a579962 >2014-01-30 07:54:14,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7a579962 >2014-01-30 07:54:19,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32ab82a2 >2014-01-30 07:54:19,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 32ab82a2 >2014-01-30 07:54:19,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 190f0867 >2014-01-30 07:54:20,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe7aa508, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@158b9ec}, log id: 190f0867 >2014-01-30 07:54:20,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 35aad936 >2014-01-30 07:54:20,616 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 35aad936 >2014-01-30 07:54:20,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 63a1e88e >2014-01-30 07:54:20,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63a1e88e >2014-01-30 07:54:24,194 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] No up server in cluster >2014-01-30 07:54:24,194 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:54:24,198 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] No up server in cluster >2014-01-30 07:54:24,198 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:54:24,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 1446ebb2 >2014-01-30 07:54:24,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 1446ebb2 >2014-01-30 07:54:24,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 5ffd26f4 >2014-01-30 07:54:25,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterTasksListVDSCommand, return: [], log id: 5ffd26f4 >2014-01-30 07:54:25,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3875ed80 >2014-01-30 07:54:26,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3875ed80 >2014-01-30 07:54:26,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c239e11 >2014-01-30 07:54:26,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fe6a6cf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd1306ce}, log id: 4c239e11 >2014-01-30 07:54:26,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1cb58200 >2014-01-30 07:54:27,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1cb58200 >2014-01-30 07:54:27,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5b75a261 >2014-01-30 07:54:27,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5b75a261 >2014-01-30 07:54:32,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: afd4008 >2014-01-30 07:54:32,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: afd4008 >2014-01-30 07:54:32,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3af2c1a5 >2014-01-30 07:54:33,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb920c48, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58f0af9f}, log id: 3af2c1a5 >2014-01-30 07:54:33,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 784b32f3 >2014-01-30 07:54:33,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 784b32f3 >2014-01-30 07:54:33,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3f78fb34 >2014-01-30 07:54:33,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3f78fb34 >2014-01-30 07:54:38,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18d5dad4 >2014-01-30 07:54:39,456 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 18d5dad4 >2014-01-30 07:54:39,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a3efe91 >2014-01-30 07:54:39,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@faebc07, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc87232d}, log id: 1a3efe91 >2014-01-30 07:54:39,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2520bcd9 >2014-01-30 07:54:40,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2520bcd9 >2014-01-30 07:54:40,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6fc5d746 >2014-01-30 07:54:40,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6fc5d746 >2014-01-30 07:54:45,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31cfa47d >2014-01-30 07:54:46,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 31cfa47d >2014-01-30 07:54:46,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4dd5977f >2014-01-30 07:54:46,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6270c50, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba727303}, log id: 4dd5977f >2014-01-30 07:54:46,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 75851758 >2014-01-30 07:54:46,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 75851758 >2014-01-30 07:54:46,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3393c7c4 >2014-01-30 07:54:47,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3393c7c4 >2014-01-30 07:54:52,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20a35da5 >2014-01-30 07:54:52,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 20a35da5 >2014-01-30 07:54:52,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 63d84283 >2014-01-30 07:54:52,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab2f3fae, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae18e584}, log id: 63d84283 >2014-01-30 07:54:52,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 668dcf4e >2014-01-30 07:54:53,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 668dcf4e >2014-01-30 07:54:53,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7eaedc39 >2014-01-30 07:54:53,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7eaedc39 >2014-01-30 07:54:58,628 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49156e4a >2014-01-30 07:54:59,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 49156e4a >2014-01-30 07:54:59,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 57497475 >2014-01-30 07:54:59,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27579f4b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@746f36cc}, log id: 57497475 >2014-01-30 07:54:59,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 424d01c4 >2014-01-30 07:54:59,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 424d01c4 >2014-01-30 07:54:59,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 20b9247d >2014-01-30 07:55:00,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 20b9247d >2014-01-30 07:55:05,215 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f5659b9 >2014-01-30 07:55:05,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1f5659b9 >2014-01-30 07:55:05,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12f8121a >2014-01-30 07:55:05,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ca02be6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adef73c1}, log id: 12f8121a >2014-01-30 07:55:05,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 722b1d49 >2014-01-30 07:55:06,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 722b1d49 >2014-01-30 07:55:06,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1fe75343 >2014-01-30 07:55:06,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fe75343 >2014-01-30 07:55:11,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23a7d245 >2014-01-30 07:55:12,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 23a7d245 >2014-01-30 07:55:12,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74dc265f >2014-01-30 07:55:12,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17ca6fba, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@929480ee}, log id: 74dc265f >2014-01-30 07:55:12,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 19e0e34b >2014-01-30 07:55:12,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 19e0e34b >2014-01-30 07:55:12,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2cb7a063 >2014-01-30 07:55:13,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2cb7a063 >2014-01-30 07:55:16,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 1b6c9e3d >2014-01-30 07:55:17,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7cf35026, log id: 1b6c9e3d >2014-01-30 07:55:17,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 4a132ee0 >2014-01-30 07:55:17,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@7205226d, log id: 4a132ee0 >2014-01-30 07:55:18,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54f0a14a >2014-01-30 07:55:18,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 54f0a14a >2014-01-30 07:55:18,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41cb098d >2014-01-30 07:55:18,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f01ea72, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a4bac7e}, log id: 41cb098d >2014-01-30 07:55:19,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 266ebdbe >2014-01-30 07:55:19,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 266ebdbe >2014-01-30 07:55:19,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 12a2894a >2014-01-30 07:55:19,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12a2894a >2014-01-30 07:55:24,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68fa521 >2014-01-30 07:55:25,049 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-5) [5cab3cac] No up server in cluster >2014-01-30 07:55:25,049 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-5) [5cab3cac] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:55:25,052 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-5) [5cab3cac] No up server in cluster >2014-01-30 07:55:25,052 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-5) [5cab3cac] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:55:25,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 1037987a >2014-01-30 07:55:25,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 68fa521 >2014-01-30 07:55:25,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1504f118 >2014-01-30 07:55:25,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfec399b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a139f6ae}, log id: 1504f118 >2014-01-30 07:55:25,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 513545b3 >2014-01-30 07:55:25,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 1037987a >2014-01-30 07:55:25,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6ace4659 >2014-01-30 07:55:25,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterTasksListVDSCommand, return: [], log id: 6ace4659 >2014-01-30 07:55:26,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 513545b3 >2014-01-30 07:55:26,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2ad63647 >2014-01-30 07:55:26,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2ad63647 >2014-01-30 07:55:31,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23d36b0c >2014-01-30 07:55:31,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 23d36b0c >2014-01-30 07:55:31,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4296fa02 >2014-01-30 07:55:32,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8425fd8a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54d4fd4c}, log id: 4296fa02 >2014-01-30 07:55:32,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5acce004 >2014-01-30 07:55:32,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5acce004 >2014-01-30 07:55:32,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 411216f6 >2014-01-30 07:55:32,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 411216f6 >2014-01-30 07:55:37,839 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6335d3c4 >2014-01-30 07:55:38,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6335d3c4 >2014-01-30 07:55:38,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 472a99d5 >2014-01-30 07:55:38,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f49a8f5e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce933548}, log id: 472a99d5 >2014-01-30 07:55:38,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 991a79c >2014-01-30 07:55:39,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 991a79c >2014-01-30 07:55:39,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 144f86b0 >2014-01-30 07:55:39,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 144f86b0 >2014-01-30 07:55:44,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 678f33d9 >2014-01-30 07:55:44,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 678f33d9 >2014-01-30 07:55:44,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37afd65 >2014-01-30 07:55:45,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cff8649, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@912a130a}, log id: 37afd65 >2014-01-30 07:55:45,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 60eb307a >2014-01-30 07:55:45,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 60eb307a >2014-01-30 07:55:45,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 723e545b >2014-01-30 07:55:45,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 723e545b >2014-01-30 07:55:50,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49a5fc73 >2014-01-30 07:55:51,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 49a5fc73 >2014-01-30 07:55:51,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e5faead >2014-01-30 07:55:51,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40d0b1bf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5be3598a}, log id: 7e5faead >2014-01-30 07:55:51,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 252a6809 >2014-01-30 07:55:52,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 252a6809 >2014-01-30 07:55:52,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4ee27b02 >2014-01-30 07:55:52,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ee27b02 >2014-01-30 07:55:57,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20d2711b >2014-01-30 07:55:57,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 20d2711b >2014-01-30 07:55:57,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5abf1e7 >2014-01-30 07:55:58,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b116ac8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7e281a7}, log id: 5abf1e7 >2014-01-30 07:55:58,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 39d550d4 >2014-01-30 07:55:58,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 39d550d4 >2014-01-30 07:55:58,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1d917208 >2014-01-30 07:55:59,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1d917208 >2014-01-30 07:56:04,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13fe71a1 >2014-01-30 07:56:04,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 13fe71a1 >2014-01-30 07:56:04,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72befa48 >2014-01-30 07:56:04,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b58b76c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b91bb21d}, log id: 72befa48 >2014-01-30 07:56:04,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5fd6c077 >2014-01-30 07:56:05,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5fd6c077 >2014-01-30 07:56:05,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 256a3519 >2014-01-30 07:56:05,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 256a3519 >2014-01-30 07:56:10,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 55786142 >2014-01-30 07:56:11,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 55786142 >2014-01-30 07:56:11,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ca21e89 >2014-01-30 07:56:11,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c1c9554, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1d13cd2d}, log id: 5ca21e89 >2014-01-30 07:56:11,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5f9a861f >2014-01-30 07:56:11,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5f9a861f >2014-01-30 07:56:11,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 145ce688 >2014-01-30 07:56:12,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 145ce688 >2014-01-30 07:56:17,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 215d7d8e >2014-01-30 07:56:17,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 215d7d8e >2014-01-30 07:56:17,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 312e25f4 >2014-01-30 07:56:17,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9757e051, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2825323}, log id: 312e25f4 >2014-01-30 07:56:17,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5157e0af >2014-01-30 07:56:18,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5157e0af >2014-01-30 07:56:18,389 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6c153ed9 >2014-01-30 07:56:18,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6c153ed9 >2014-01-30 07:56:23,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6022a6e0 >2014-01-30 07:56:24,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6022a6e0 >2014-01-30 07:56:24,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: fc2ac7d >2014-01-30 07:56:24,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61afd772, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8e5b202}, log id: fc2ac7d >2014-01-30 07:56:24,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 53ac7e36 >2014-01-30 07:56:24,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 53ac7e36 >2014-01-30 07:56:24,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1fa86366 >2014-01-30 07:56:25,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1fa86366 >2014-01-30 07:56:25,814 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2014-01-30 07:56:25,814 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:56:25,817 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2014-01-30 07:56:25,817 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:56:25,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1de263fe >2014-01-30 07:56:26,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 1de263fe >2014-01-30 07:56:26,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3a4e98a6 >2014-01-30 07:56:26,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [], log id: 3a4e98a6 >2014-01-30 07:56:30,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5eab51c1 >2014-01-30 07:56:30,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5eab51c1 >2014-01-30 07:56:30,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1209d65f >2014-01-30 07:56:30,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adcbbc0d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b00fb7e}, log id: 1209d65f >2014-01-30 07:56:31,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4cd0db3c >2014-01-30 07:56:31,502 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4cd0db3c >2014-01-30 07:56:31,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7c7b7b0b >2014-01-30 07:56:31,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c7b7b0b >2014-01-30 07:56:36,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3551611e >2014-01-30 07:56:37,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3551611e >2014-01-30 07:56:37,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b37584 >2014-01-30 07:56:37,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@485bc25c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca6f0e89}, log id: b37584 >2014-01-30 07:56:37,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3319a510 >2014-01-30 07:56:38,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3319a510 >2014-01-30 07:56:38,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7c7ed04 >2014-01-30 07:56:38,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c7ed04 >2014-01-30 07:56:43,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 487913de >2014-01-30 07:56:43,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 487913de >2014-01-30 07:56:43,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 137e16d7 >2014-01-30 07:56:44,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@735324f3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@752274ff}, log id: 137e16d7 >2014-01-30 07:56:44,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 259c7741 >2014-01-30 07:56:44,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 259c7741 >2014-01-30 07:56:44,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1b88b28 >2014-01-30 07:56:44,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b88b28 >2014-01-30 07:56:49,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2bfe6f83 >2014-01-30 07:56:50,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2bfe6f83 >2014-01-30 07:56:50,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c03781f >2014-01-30 07:56:50,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45424cf6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81dea580}, log id: 6c03781f >2014-01-30 07:56:50,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 637b0958 >2014-01-30 07:56:51,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 637b0958 >2014-01-30 07:56:51,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d748a65 >2014-01-30 07:56:51,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7d748a65 >2014-01-30 07:56:56,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a558c04 >2014-01-30 07:56:56,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5a558c04 >2014-01-30 07:56:56,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54319878 >2014-01-30 07:56:57,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@122bf024, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67e2b531}, log id: 54319878 >2014-01-30 07:56:57,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2e61a558 >2014-01-30 07:56:57,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2e61a558 >2014-01-30 07:56:57,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 79ae51da >2014-01-30 07:56:57,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79ae51da >2014-01-30 07:57:02,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2356f1f5 >2014-01-30 07:57:03,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2356f1f5 >2014-01-30 07:57:03,449 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e01e91b >2014-01-30 07:57:03,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9535678, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90caa771}, log id: 6e01e91b >2014-01-30 07:57:03,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6a638574 >2014-01-30 07:57:04,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6a638574 >2014-01-30 07:57:04,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5bc5cd0c >2014-01-30 07:57:04,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5bc5cd0c >2014-01-30 07:57:09,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5442accc >2014-01-30 07:57:09,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5442accc >2014-01-30 07:57:09,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 219bbe33 >2014-01-30 07:57:10,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b077a2ae, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dbc58413}, log id: 219bbe33 >2014-01-30 07:57:10,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 25d8f6e >2014-01-30 07:57:10,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 25d8f6e >2014-01-30 07:57:10,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 330fdf62 >2014-01-30 07:57:11,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 330fdf62 >2014-01-30 07:57:16,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9bdcb73 >2014-01-30 07:57:16,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 9bdcb73 >2014-01-30 07:57:16,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3991890 >2014-01-30 07:57:16,816 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be3c0dcc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63a74560}, log id: 3991890 >2014-01-30 07:57:16,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a466dc5 >2014-01-30 07:57:17,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7a466dc5 >2014-01-30 07:57:17,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5948914d >2014-01-30 07:57:17,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5948914d >2014-01-30 07:57:22,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e4f4c0b >2014-01-30 07:57:23,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: e4f4c0b >2014-01-30 07:57:23,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b4f1847 >2014-01-30 07:57:23,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed866659, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bff9a0c}, log id: 2b4f1847 >2014-01-30 07:57:23,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 456dd0c5 >2014-01-30 07:57:23,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 456dd0c5 >2014-01-30 07:57:23,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2b18dd11 >2014-01-30 07:57:24,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2b18dd11 >2014-01-30 07:57:26,634 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-64) [4dd3051e] No up server in cluster >2014-01-30 07:57:26,635 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-64) [4dd3051e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:57:26,638 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-64) [4dd3051e] No up server in cluster >2014-01-30 07:57:26,638 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-64) [4dd3051e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:57:26,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 50ae170a >2014-01-30 07:57:27,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 50ae170a >2014-01-30 07:57:27,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 770eaf55 >2014-01-30 07:57:27,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterTasksListVDSCommand, return: [], log id: 770eaf55 >2014-01-30 07:57:29,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 45bcb2ef >2014-01-30 07:57:29,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 45bcb2ef >2014-01-30 07:57:29,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a208c1a >2014-01-30 07:57:29,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96cf1bb6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98641a10}, log id: a208c1a >2014-01-30 07:57:29,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4c8ff371 >2014-01-30 07:57:30,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4c8ff371 >2014-01-30 07:57:30,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5c6619fc >2014-01-30 07:57:30,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5c6619fc >2014-01-30 07:57:35,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a719172 >2014-01-30 07:57:36,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2a719172 >2014-01-30 07:57:36,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e549c30 >2014-01-30 07:57:36,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@319e358e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95608c21}, log id: 3e549c30 >2014-01-30 07:57:36,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7dfad083 >2014-01-30 07:57:36,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7dfad083 >2014-01-30 07:57:36,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3e5f5ed8 >2014-01-30 07:57:37,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e5f5ed8 >2014-01-30 07:57:42,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7330e61d >2014-01-30 07:57:42,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7330e61d >2014-01-30 07:57:42,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d3d538e >2014-01-30 07:57:42,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc5298c6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9998df7c}, log id: d3d538e >2014-01-30 07:57:42,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6877337c >2014-01-30 07:57:43,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6877337c >2014-01-30 07:57:43,504 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65a98c31 >2014-01-30 07:57:43,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 65a98c31 >2014-01-30 07:57:48,761 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56ff299f >2014-01-30 07:57:49,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 56ff299f >2014-01-30 07:57:49,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 121dbe1d >2014-01-30 07:57:49,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79ebbd5d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e815b4}, log id: 121dbe1d >2014-01-30 07:57:49,543 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: c972b3 >2014-01-30 07:57:50,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: c972b3 >2014-01-30 07:57:50,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 12ca969b >2014-01-30 07:57:50,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 12ca969b >2014-01-30 07:57:55,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68bf7a9d >2014-01-30 07:57:55,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 68bf7a9d >2014-01-30 07:57:55,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ea7e6a0 >2014-01-30 07:57:56,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf7d5fbb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@770d68fa}, log id: 2ea7e6a0 >2014-01-30 07:57:56,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2350baa2 >2014-01-30 07:57:56,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2350baa2 >2014-01-30 07:57:56,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 60c6a698 >2014-01-30 07:57:56,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 60c6a698 >2014-01-30 07:58:01,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59423494 >2014-01-30 07:58:02,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 59423494 >2014-01-30 07:58:02,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 742326 >2014-01-30 07:58:02,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@acfe2052, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9dd90a78}, log id: 742326 >2014-01-30 07:58:02,648 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6a29d662 >2014-01-30 07:58:03,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6a29d662 >2014-01-30 07:58:03,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4dc5f8e9 >2014-01-30 07:58:03,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4dc5f8e9 >2014-01-30 07:58:08,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e7c5124 >2014-01-30 07:58:08,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6e7c5124 >2014-01-30 07:58:08,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5338532e >2014-01-30 07:58:09,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a65160c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3bec0a1}, log id: 5338532e >2014-01-30 07:58:09,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4fe94bee >2014-01-30 07:58:09,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4fe94bee >2014-01-30 07:58:09,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 55f7ce11 >2014-01-30 07:58:09,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55f7ce11 >2014-01-30 07:58:14,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4995388f >2014-01-30 07:58:15,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4995388f >2014-01-30 07:58:15,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56067d07 >2014-01-30 07:58:15,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e27bdb2b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b487fd37}, log id: 56067d07 >2014-01-30 07:58:15,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5fdddeb1 >2014-01-30 07:58:16,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5fdddeb1 >2014-01-30 07:58:16,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 19c2b18 >2014-01-30 07:58:16,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 19c2b18 >2014-01-30 07:58:21,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12db6f98 >2014-01-30 07:58:21,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 12db6f98 >2014-01-30 07:58:21,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a0397f0 >2014-01-30 07:58:22,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@442d656c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78676e10}, log id: 2a0397f0 >2014-01-30 07:58:22,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 69c9afd0 >2014-01-30 07:58:22,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 69c9afd0 >2014-01-30 07:58:22,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2c8a30fb >2014-01-30 07:58:23,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2c8a30fb >2014-01-30 07:58:27,466 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) [b80ce35] No up server in cluster >2014-01-30 07:58:27,467 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) [b80ce35] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:58:27,469 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) [b80ce35] No up server in cluster >2014-01-30 07:58:27,469 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) [b80ce35] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:58:27,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: c9fb0a4 >2014-01-30 07:58:28,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: c9fb0a4 >2014-01-30 07:58:28,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 36285a9a >2014-01-30 07:58:28,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3596916d >2014-01-30 07:58:28,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterTasksListVDSCommand, return: [], log id: 36285a9a >2014-01-30 07:58:28,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3596916d >2014-01-30 07:58:28,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54028104 >2014-01-30 07:58:28,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@142bcbb5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47308d6}, log id: 54028104 >2014-01-30 07:58:28,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4c1c99d3 >2014-01-30 07:58:29,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4c1c99d3 >2014-01-30 07:58:29,348 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3e51aead >2014-01-30 07:58:29,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e51aead >2014-01-30 07:58:34,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ef96a36 >2014-01-30 07:58:35,117 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: ef96a36 >2014-01-30 07:58:35,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 742a9e7d >2014-01-30 07:58:35,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6711821, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1616b756}, log id: 742a9e7d >2014-01-30 07:58:35,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 713d2966 >2014-01-30 07:58:35,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 713d2966 >2014-01-30 07:58:35,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 147ee64a >2014-01-30 07:58:36,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 147ee64a >2014-01-30 07:58:41,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b0a1850 >2014-01-30 07:58:41,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4b0a1850 >2014-01-30 07:58:41,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ad5857d >2014-01-30 07:58:41,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a41b74e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa6af992}, log id: ad5857d >2014-01-30 07:58:42,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6273cf18 >2014-01-30 07:58:42,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6273cf18 >2014-01-30 07:58:42,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1b777c71 >2014-01-30 07:58:42,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b777c71 >2014-01-30 07:58:47,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30c622da >2014-01-30 07:58:48,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 30c622da >2014-01-30 07:58:48,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 365120a6 >2014-01-30 07:58:48,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@291ea263, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75750618}, log id: 365120a6 >2014-01-30 07:58:48,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 16fc2ced >2014-01-30 07:58:49,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 16fc2ced >2014-01-30 07:58:49,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 59e73c3f >2014-01-30 07:58:49,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59e73c3f >2014-01-30 07:58:54,329 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16b41be6 >2014-01-30 07:58:54,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 16b41be6 >2014-01-30 07:58:54,820 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1326d3a7 >2014-01-30 07:58:55,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfcdcca9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d219804}, log id: 1326d3a7 >2014-01-30 07:58:55,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3e3c2334 >2014-01-30 07:58:55,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3e3c2334 >2014-01-30 07:58:55,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 25d95132 >2014-01-30 07:58:55,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25d95132 >2014-01-30 07:59:00,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a9e554e >2014-01-30 07:59:01,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3a9e554e >2014-01-30 07:59:01,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6353def7 >2014-01-30 07:59:01,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9440c962, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bac5b456}, log id: 6353def7 >2014-01-30 07:59:01,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4409a732 >2014-01-30 07:59:02,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4409a732 >2014-01-30 07:59:02,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 37243a22 >2014-01-30 07:59:02,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 37243a22 >2014-01-30 07:59:07,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 63855197 >2014-01-30 07:59:07,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 63855197 >2014-01-30 07:59:07,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e236915 >2014-01-30 07:59:08,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c938512e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca5a79d2}, log id: 4e236915 >2014-01-30 07:59:08,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5ecbfa85 >2014-01-30 07:59:08,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5ecbfa85 >2014-01-30 07:59:08,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1695834e >2014-01-30 07:59:08,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1695834e >2014-01-30 07:59:13,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 70616edc >2014-01-30 07:59:14,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 70616edc >2014-01-30 07:59:14,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f8a2f9f >2014-01-30 07:59:14,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32225f5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7233907b}, log id: 2f8a2f9f >2014-01-30 07:59:14,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1be7424c >2014-01-30 07:59:15,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1be7424c >2014-01-30 07:59:15,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1149c3f3 >2014-01-30 07:59:15,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1149c3f3 >2014-01-30 07:59:16,464 ERROR [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-3) USER_FAILED_TO_AUTHENTICATE : admin >2014-01-30 07:59:16,464 WARN [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-3) CanDoAction of action LoginAdminUser failed. Reasons:USER_FAILED_TO_AUTHENTICATE >2014-01-30 07:59:18,369 INFO [org.ovirt.engine.core.bll.LoginAdminUserCommand] (ajp-/127.0.0.1:8702-6) Running command: LoginAdminUserCommand internal: false. >2014-01-30 07:59:18,379 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-6) Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: User admin@internal logged in. >2014-01-30 07:59:18,421 INFO [org.ovirt.engine.api.restapi.security.auth.LoginValidator] (ajp-/127.0.0.1:8702-1) Validating session failed, reason: Session does not exist. >2014-01-30 07:59:20,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32f369d9 >2014-01-30 07:59:21,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 32f369d9 >2014-01-30 07:59:21,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1602136f >2014-01-30 07:59:21,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18ef5de8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@699ec908}, log id: 1602136f >2014-01-30 07:59:21,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1f504287 >2014-01-30 07:59:21,817 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1f504287 >2014-01-30 07:59:21,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7e3389c0 >2014-01-30 07:59:22,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e3389c0 >2014-01-30 07:59:27,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24e22346 >2014-01-30 07:59:27,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 24e22346 >2014-01-30 07:59:27,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 476e722d >2014-01-30 07:59:27,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8c48122, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@60abc748}, log id: 476e722d >2014-01-30 07:59:27,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4211b3c4 >2014-01-30 07:59:28,311 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] No up server in cluster >2014-01-30 07:59:28,311 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:59:28,313 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] No up server in cluster >2014-01-30 07:59:28,313 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 07:59:28,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 37b2857 >2014-01-30 07:59:28,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4211b3c4 >2014-01-30 07:59:28,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 44a97395 >2014-01-30 07:59:28,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 44a97395 >2014-01-30 07:59:28,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 37b2857 >2014-01-30 07:59:28,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a20b797 >2014-01-30 07:59:29,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterTasksListVDSCommand, return: [], log id: 7a20b797 >2014-01-30 07:59:33,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59ffcde6 >2014-01-30 07:59:34,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 59ffcde6 >2014-01-30 07:59:34,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10fa86a5 >2014-01-30 07:59:34,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@214bf971, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4de3f7a}, log id: 10fa86a5 >2014-01-30 07:59:34,419 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d1be3db >2014-01-30 07:59:34,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7d1be3db >2014-01-30 07:59:34,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 21575e7d >2014-01-30 07:59:35,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21575e7d >2014-01-30 07:59:40,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1795a3e7 >2014-01-30 07:59:40,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1795a3e7 >2014-01-30 07:59:40,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 641864af >2014-01-30 07:59:40,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64b686d4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7012d0}, log id: 641864af >2014-01-30 07:59:40,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7b7dd603 >2014-01-30 07:59:41,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7b7dd603 >2014-01-30 07:59:41,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: e8aa53f >2014-01-30 07:59:41,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: e8aa53f >2014-01-30 07:59:46,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4bc7062 >2014-01-30 07:59:47,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4bc7062 >2014-01-30 07:59:47,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 736473d8 >2014-01-30 07:59:47,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa7a0847, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f5afaf11}, log id: 736473d8 >2014-01-30 07:59:47,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 39e03db7 >2014-01-30 07:59:48,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 39e03db7 >2014-01-30 07:59:48,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4c8b667f >2014-01-30 07:59:48,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c8b667f >2014-01-30 07:59:53,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e298ebd >2014-01-30 07:59:53,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6e298ebd >2014-01-30 07:59:53,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54e93c86 >2014-01-30 07:59:54,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@374dd969, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b133280}, log id: 54e93c86 >2014-01-30 07:59:54,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 283e8d1 >2014-01-30 07:59:54,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 283e8d1 >2014-01-30 07:59:54,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 73464dbe >2014-01-30 07:59:54,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 73464dbe >2014-01-30 07:59:59,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d7cbbfe >2014-01-30 08:00:00,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: d7cbbfe >2014-01-30 08:00:00,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 124f6443 >2014-01-30 08:00:00,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39724529, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee50c911}, log id: 124f6443 >2014-01-30 08:00:00,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3d49cd58 >2014-01-30 08:00:01,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3d49cd58 >2014-01-30 08:00:01,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 34ed2013 >2014-01-30 08:00:01,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 34ed2013 >2014-01-30 08:00:06,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b99343d >2014-01-30 08:00:06,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7b99343d >2014-01-30 08:00:06,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1969c481 >2014-01-30 08:00:07,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@661be8bb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d62bb97f}, log id: 1969c481 >2014-01-30 08:00:07,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 25800b33 >2014-01-30 08:00:07,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 25800b33 >2014-01-30 08:00:07,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4c694211 >2014-01-30 08:00:07,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c694211 >2014-01-30 08:00:12,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25c73851 >2014-01-30 08:00:13,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 25c73851 >2014-01-30 08:00:13,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6bae3bf3 >2014-01-30 08:00:13,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@610b93d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e0dea2f}, log id: 6bae3bf3 >2014-01-30 08:00:13,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3c3e3d66 >2014-01-30 08:00:14,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3c3e3d66 >2014-01-30 08:00:14,260 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2cfa9f1b >2014-01-30 08:00:14,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2cfa9f1b >2014-01-30 08:00:17,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 51c43797 >2014-01-30 08:00:17,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@f17c013, log id: 51c43797 >2014-01-30 08:00:17,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 60432722 >2014-01-30 08:00:18,017 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@15940ac9, log id: 60432722 >2014-01-30 08:00:19,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36dc4bd4 >2014-01-30 08:00:20,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 36dc4bd4 >2014-01-30 08:00:20,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12c9d220 >2014-01-30 08:00:20,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17785e2a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3bfc103}, log id: 12c9d220 >2014-01-30 08:00:20,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 24fd9951 >2014-01-30 08:00:20,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 24fd9951 >2014-01-30 08:00:20,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 18238c11 >2014-01-30 08:00:21,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 18238c11 >2014-01-30 08:00:26,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 471def56 >2014-01-30 08:00:26,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 471def56 >2014-01-30 08:00:26,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77428ac8 >2014-01-30 08:00:26,840 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a9a6e3a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42d1ff9e}, log id: 77428ac8 >2014-01-30 08:00:26,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 696c9a5b >2014-01-30 08:00:27,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 696c9a5b >2014-01-30 08:00:27,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 79e9e790 >2014-01-30 08:00:27,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79e9e790 >2014-01-30 08:00:29,099 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-39) No up server in cluster >2014-01-30 08:00:29,099 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-39) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:00:29,102 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-39) No up server in cluster >2014-01-30 08:00:29,103 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-39) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:00:29,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 64bac65d >2014-01-30 08:00:29,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 64bac65d >2014-01-30 08:00:29,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 8b50e7d >2014-01-30 08:00:29,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterTasksListVDSCommand, return: [], log id: 8b50e7d >2014-01-30 08:00:32,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65829f02 >2014-01-30 08:00:33,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 65829f02 >2014-01-30 08:00:33,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1abe9c90 >2014-01-30 08:00:33,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4bde53a0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7cc95fc6}, log id: 1abe9c90 >2014-01-30 08:00:33,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6809833 >2014-01-30 08:00:33,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6809833 >2014-01-30 08:00:33,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 70a2791d >2014-01-30 08:00:34,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70a2791d >2014-01-30 08:00:39,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b0fc34d >2014-01-30 08:00:39,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6b0fc34d >2014-01-30 08:00:39,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58b39b10 >2014-01-30 08:00:40,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71aaf555, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@360aef16}, log id: 58b39b10 >2014-01-30 08:00:40,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2dfc5616 >2014-01-30 08:00:40,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2dfc5616 >2014-01-30 08:00:40,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 59707f60 >2014-01-30 08:00:40,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 59707f60 >2014-01-30 08:00:45,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 607675f >2014-01-30 08:00:46,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 607675f >2014-01-30 08:00:46,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 359bb36c >2014-01-30 08:00:46,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9490064e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81b12f4f}, log id: 359bb36c >2014-01-30 08:00:46,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 74d0fbd2 >2014-01-30 08:00:47,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 74d0fbd2 >2014-01-30 08:00:47,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4482fff7 >2014-01-30 08:00:47,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4482fff7 >2014-01-30 08:00:52,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53111c03 >2014-01-30 08:00:52,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 53111c03 >2014-01-30 08:00:52,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a2a8bc5 >2014-01-30 08:00:53,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55e3261d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f0187f}, log id: 1a2a8bc5 >2014-01-30 08:00:53,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3e6d6697 >2014-01-30 08:00:53,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3e6d6697 >2014-01-30 08:00:53,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4fde6091 >2014-01-30 08:00:53,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4fde6091 >2014-01-30 08:00:58,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: bea596 >2014-01-30 08:00:59,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: bea596 >2014-01-30 08:00:59,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 211b5967 >2014-01-30 08:00:59,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df942d78, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9ba04b2}, log id: 211b5967 >2014-01-30 08:00:59,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5d26cfb3 >2014-01-30 08:01:00,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5d26cfb3 >2014-01-30 08:01:00,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3aa8b6cb >2014-01-30 08:01:00,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3aa8b6cb >2014-01-30 08:01:05,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 373f29ae >2014-01-30 08:01:05,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 373f29ae >2014-01-30 08:01:05,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c129417 >2014-01-30 08:01:06,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@849d63be, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8fc9462e}, log id: 6c129417 >2014-01-30 08:01:06,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a14f423 >2014-01-30 08:01:06,740 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7a14f423 >2014-01-30 08:01:06,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 29a5e473 >2014-01-30 08:01:06,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29a5e473 >2014-01-30 08:01:12,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 619271d >2014-01-30 08:01:12,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 619271d >2014-01-30 08:01:12,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d5056f >2014-01-30 08:01:12,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d8e5669, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b087336b}, log id: 4d5056f >2014-01-30 08:01:12,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7282330f >2014-01-30 08:01:13,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7282330f >2014-01-30 08:01:13,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6d7abbb6 >2014-01-30 08:01:13,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d7abbb6 >2014-01-30 08:01:18,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3af46247 >2014-01-30 08:01:18,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3af46247 >2014-01-30 08:01:18,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ac08271 >2014-01-30 08:01:19,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6003683d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa111a4d}, log id: 5ac08271 >2014-01-30 08:01:19,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 380c5153 >2014-01-30 08:01:19,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 380c5153 >2014-01-30 08:01:19,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 16c3080d >2014-01-30 08:01:20,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 16c3080d >2014-01-30 08:01:25,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a030de4 >2014-01-30 08:01:25,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7a030de4 >2014-01-30 08:01:25,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64ed2442 >2014-01-30 08:01:25,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7b57973, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c43c3c2}, log id: 64ed2442 >2014-01-30 08:01:25,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 18c515ac >2014-01-30 08:01:26,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 18c515ac >2014-01-30 08:01:26,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 74f52c3a >2014-01-30 08:01:26,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 74f52c3a >2014-01-30 08:01:29,914 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-25) [5d39b68f] No up server in cluster >2014-01-30 08:01:29,914 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-25) [5d39b68f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:01:29,917 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-25) [5d39b68f] No up server in cluster >2014-01-30 08:01:29,918 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-25) [5d39b68f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:01:29,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 616ff358 >2014-01-30 08:01:30,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 616ff358 >2014-01-30 08:01:30,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7974465d >2014-01-30 08:01:30,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterTasksListVDSCommand, return: [], log id: 7974465d >2014-01-30 08:01:31,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a070f56 >2014-01-30 08:01:32,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4a070f56 >2014-01-30 08:01:32,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d551c27 >2014-01-30 08:01:32,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d59086, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf4ae58}, log id: 7d551c27 >2014-01-30 08:01:32,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 67cb4058 >2014-01-30 08:01:32,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 67cb4058 >2014-01-30 08:01:32,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: f1d317d >2014-01-30 08:01:33,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: f1d317d >2014-01-30 08:01:38,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14682899 >2014-01-30 08:01:38,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 14682899 >2014-01-30 08:01:38,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 73a87896 >2014-01-30 08:01:38,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfe27432, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0a18b63}, log id: 73a87896 >2014-01-30 08:01:39,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4d40ba42 >2014-01-30 08:01:39,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4d40ba42 >2014-01-30 08:01:39,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7de388b >2014-01-30 08:01:39,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7de388b >2014-01-30 08:01:44,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d75a027 >2014-01-30 08:01:45,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3d75a027 >2014-01-30 08:01:45,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65d0e692 >2014-01-30 08:01:45,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c13977c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@896defe7}, log id: 65d0e692 >2014-01-30 08:01:45,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 398783d1 >2014-01-30 08:01:46,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 398783d1 >2014-01-30 08:01:46,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3a7b9df9 >2014-01-30 08:01:46,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a7b9df9 >2014-01-30 08:01:51,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 747cb901 >2014-01-30 08:01:51,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 747cb901 >2014-01-30 08:01:51,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40d7912c >2014-01-30 08:01:52,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31d31fd0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9db555aa}, log id: 40d7912c >2014-01-30 08:01:52,165 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3925bf7 >2014-01-30 08:01:52,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3925bf7 >2014-01-30 08:01:52,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 665f7e25 >2014-01-30 08:01:52,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 665f7e25 >2014-01-30 08:01:57,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d19e614 >2014-01-30 08:01:58,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4d19e614 >2014-01-30 08:01:58,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 157846c1 >2014-01-30 08:01:58,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45efbb31, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b0990a3}, log id: 157846c1 >2014-01-30 08:01:58,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7c192780 >2014-01-30 08:01:59,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7c192780 >2014-01-30 08:01:59,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6d5d92d7 >2014-01-30 08:01:59,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6d5d92d7 >2014-01-30 08:02:04,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51820a57 >2014-01-30 08:02:04,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 51820a57 >2014-01-30 08:02:04,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1166d932 >2014-01-30 08:02:05,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6f0bcd62, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cedce7c}, log id: 1166d932 >2014-01-30 08:02:05,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4d0180f9 >2014-01-30 08:02:05,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4d0180f9 >2014-01-30 08:02:05,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 55f5c150 >2014-01-30 08:02:06,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55f5c150 >2014-01-30 08:02:11,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d79719a >2014-01-30 08:02:11,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4d79719a >2014-01-30 08:02:11,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3725f22 >2014-01-30 08:02:11,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e3d0012, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@643f70de}, log id: 3725f22 >2014-01-30 08:02:11,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 463ecca0 >2014-01-30 08:02:12,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 463ecca0 >2014-01-30 08:02:12,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7e4cc332 >2014-01-30 08:02:12,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7e4cc332 >2014-01-30 08:02:17,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 357b625f >2014-01-30 08:02:18,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 357b625f >2014-01-30 08:02:18,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 231538ad >2014-01-30 08:02:18,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec0f700c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e9df4d6}, log id: 231538ad >2014-01-30 08:02:18,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7a3caa6e >2014-01-30 08:02:18,926 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7a3caa6e >2014-01-30 08:02:18,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1b9351e5 >2014-01-30 08:02:19,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1b9351e5 >2014-01-30 08:02:24,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1eea97d4 >2014-01-30 08:02:24,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1eea97d4 >2014-01-30 08:02:24,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ad30456 >2014-01-30 08:02:24,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83eeb627, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21eb8079}, log id: 1ad30456 >2014-01-30 08:02:24,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7d464e05 >2014-01-30 08:02:25,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7d464e05 >2014-01-30 08:02:25,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: aa96e54 >2014-01-30 08:02:25,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: aa96e54 >2014-01-30 08:02:30,749 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-86) [63ec361] No up server in cluster >2014-01-30 08:02:30,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 781b66bd >2014-01-30 08:02:30,749 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-86) [63ec361] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:02:30,752 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-86) [63ec361] No up server in cluster >2014-01-30 08:02:30,752 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-86) [63ec361] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:02:30,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 91c1ce3 >2014-01-30 08:02:31,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 781b66bd >2014-01-30 08:02:31,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 209b1a09 >2014-01-30 08:02:31,258 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 91c1ce3 >2014-01-30 08:02:31,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 385a39b8 >2014-01-30 08:02:31,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19f83f4d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82ecbef9}, log id: 209b1a09 >2014-01-30 08:02:31,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: af082da >2014-01-30 08:02:31,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterTasksListVDSCommand, return: [], log id: 385a39b8 >2014-01-30 08:02:31,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: af082da >2014-01-30 08:02:31,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1dc199a0 >2014-01-30 08:02:32,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1dc199a0 >2014-01-30 08:02:37,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c1aaa0 >2014-01-30 08:02:37,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c1aaa0 >2014-01-30 08:02:37,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9df79d1 >2014-01-30 08:02:38,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b4b345f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b76b8318}, log id: 9df79d1 >2014-01-30 08:02:38,063 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 56c667f8 >2014-01-30 08:02:38,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 56c667f8 >2014-01-30 08:02:38,547 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 49555566 >2014-01-30 08:02:38,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 49555566 >2014-01-30 08:02:43,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c7cca64 >2014-01-30 08:02:44,296 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1c7cca64 >2014-01-30 08:02:44,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51b80c87 >2014-01-30 08:02:44,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed3185c7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e124269a}, log id: 51b80c87 >2014-01-30 08:02:44,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4133cd7d >2014-01-30 08:02:45,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4133cd7d >2014-01-30 08:02:45,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 67d07833 >2014-01-30 08:02:45,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67d07833 >2014-01-30 08:02:50,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7bc3f1fd >2014-01-30 08:02:50,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7bc3f1fd >2014-01-30 08:02:50,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c7d761a >2014-01-30 08:02:51,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@785cade8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@58ba234c}, log id: 2c7d761a >2014-01-30 08:02:51,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3d66478a >2014-01-30 08:02:51,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3d66478a >2014-01-30 08:02:51,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 109ba7f >2014-01-30 08:02:51,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 109ba7f >2014-01-30 08:02:56,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46de20c4 >2014-01-30 08:02:57,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 46de20c4 >2014-01-30 08:02:57,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23123389 >2014-01-30 08:02:57,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8bb8973, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29b12548}, log id: 23123389 >2014-01-30 08:02:57,720 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 48f23c0a >2014-01-30 08:02:58,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 48f23c0a >2014-01-30 08:02:58,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1a62e3a4 >2014-01-30 08:02:58,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a62e3a4 >2014-01-30 08:03:03,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 523877b5 >2014-01-30 08:03:03,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 523877b5 >2014-01-30 08:03:03,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3cb13777 >2014-01-30 08:03:04,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f122ef3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43fd3130}, log id: 3cb13777 >2014-01-30 08:03:04,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3df9b8b3 >2014-01-30 08:03:04,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3df9b8b3 >2014-01-30 08:03:04,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4c98ed97 >2014-01-30 08:03:05,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4c98ed97 >2014-01-30 08:03:10,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c2b4f87 >2014-01-30 08:03:10,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1c2b4f87 >2014-01-30 08:03:10,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 311fe499 >2014-01-30 08:03:10,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0f3d74b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6cd8948}, log id: 311fe499 >2014-01-30 08:03:10,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1374c584 >2014-01-30 08:03:11,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1374c584 >2014-01-30 08:03:11,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 78f73830 >2014-01-30 08:03:11,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 78f73830 >2014-01-30 08:03:16,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 429d47c8 >2014-01-30 08:03:17,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 429d47c8 >2014-01-30 08:03:17,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a7c00b4 >2014-01-30 08:03:17,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d82197ae, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea749022}, log id: 3a7c00b4 >2014-01-30 08:03:17,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6b680b46 >2014-01-30 08:03:17,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6b680b46 >2014-01-30 08:03:17,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 21acb0f8 >2014-01-30 08:03:18,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 21acb0f8 >2014-01-30 08:03:23,136 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 111bf9fb >2014-01-30 08:03:23,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 111bf9fb >2014-01-30 08:03:23,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 248156c4 >2014-01-30 08:03:23,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1ce4e29, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@876639e2}, log id: 248156c4 >2014-01-30 08:03:23,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6360abd4 >2014-01-30 08:03:24,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6360abd4 >2014-01-30 08:03:24,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 637635b6 >2014-01-30 08:03:24,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 637635b6 >2014-01-30 08:03:29,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6bc85ad8 >2014-01-30 08:03:30,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6bc85ad8 >2014-01-30 08:03:30,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 702546e2 >2014-01-30 08:03:30,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@291909a6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aead75b7}, log id: 702546e2 >2014-01-30 08:03:30,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 150889e1 >2014-01-30 08:03:30,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 150889e1 >2014-01-30 08:03:30,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 58c3f57 >2014-01-30 08:03:31,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 58c3f57 >2014-01-30 08:03:31,545 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) [5049497] No up server in cluster >2014-01-30 08:03:31,545 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) [5049497] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:03:31,548 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) [5049497] No up server in cluster >2014-01-30 08:03:31,548 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) [5049497] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:03:31,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 7c1a6c32 >2014-01-30 08:03:32,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 7c1a6c32 >2014-01-30 08:03:32,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 4f1957ae >2014-01-30 08:03:32,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterTasksListVDSCommand, return: [], log id: 4f1957ae >2014-01-30 08:03:36,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71e9d0c0 >2014-01-30 08:03:36,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 71e9d0c0 >2014-01-30 08:03:36,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: fc52750 >2014-01-30 08:03:37,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@acc67893, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@727b565a}, log id: fc52750 >2014-01-30 08:03:37,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 24410f1 >2014-01-30 08:03:37,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 24410f1 >2014-01-30 08:03:37,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 223f0b86 >2014-01-30 08:03:37,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 223f0b86 >2014-01-30 08:03:42,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 214a473a >2014-01-30 08:03:43,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 214a473a >2014-01-30 08:03:43,321 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 486d0b99 >2014-01-30 08:03:43,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38d27f65, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@924c1366}, log id: 486d0b99 >2014-01-30 08:03:43,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 83ca041 >2014-01-30 08:03:44,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 83ca041 >2014-01-30 08:03:44,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 41a1440a >2014-01-30 08:03:44,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 41a1440a >2014-01-30 08:03:49,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a859907 >2014-01-30 08:03:49,886 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6a859907 >2014-01-30 08:03:49,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56f5a802 >2014-01-30 08:03:50,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b77fe742, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eef0ce18}, log id: 56f5a802 >2014-01-30 08:03:50,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 672a1747 >2014-01-30 08:03:50,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 672a1747 >2014-01-30 08:03:50,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 524ee516 >2014-01-30 08:03:50,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 524ee516 >2014-01-30 08:03:55,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27a175e4 >2014-01-30 08:03:56,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 27a175e4 >2014-01-30 08:03:56,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56adbba5 >2014-01-30 08:03:56,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a09ca880, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7cf2b217}, log id: 56adbba5 >2014-01-30 08:03:56,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3d97393 >2014-01-30 08:03:57,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3d97393 >2014-01-30 08:03:57,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 70fb2766 >2014-01-30 08:03:57,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 70fb2766 >2014-01-30 08:04:02,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a4711a >2014-01-30 08:04:02,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1a4711a >2014-01-30 08:04:02,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 715d717f >2014-01-30 08:04:03,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8b0605d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6799e654}, log id: 715d717f >2014-01-30 08:04:03,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5ee63cf4 >2014-01-30 08:04:03,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5ee63cf4 >2014-01-30 08:04:03,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1226342b >2014-01-30 08:04:04,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1226342b >2014-01-30 08:04:09,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21af0520 >2014-01-30 08:04:09,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 21af0520 >2014-01-30 08:04:09,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16d52bec >2014-01-30 08:04:09,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82b08b52, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb28f459}, log id: 16d52bec >2014-01-30 08:04:09,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 327557fa >2014-01-30 08:04:10,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 327557fa >2014-01-30 08:04:10,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2e1ef80d >2014-01-30 08:04:10,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2e1ef80d >2014-01-30 08:04:15,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 57a51e6c >2014-01-30 08:04:16,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 57a51e6c >2014-01-30 08:04:16,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 668bcac9 >2014-01-30 08:04:16,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb69d07, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81ca7b0e}, log id: 668bcac9 >2014-01-30 08:04:16,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 66caea25 >2014-01-30 08:04:16,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 66caea25 >2014-01-30 08:04:16,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 29795e40 >2014-01-30 08:04:17,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 29795e40 >2014-01-30 08:04:22,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f5cfa25 >2014-01-30 08:04:22,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7f5cfa25 >2014-01-30 08:04:22,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4175f92b >2014-01-30 08:04:22,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb4e73f6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79059e8d}, log id: 4175f92b >2014-01-30 08:04:22,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4a1990c9 >2014-01-30 08:04:23,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4a1990c9 >2014-01-30 08:04:23,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 62c15d22 >2014-01-30 08:04:23,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 62c15d22 >2014-01-30 08:04:28,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5bef5436 >2014-01-30 08:04:29,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5bef5436 >2014-01-30 08:04:29,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76f4b22e >2014-01-30 08:04:29,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f22414, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ad9df9}, log id: 76f4b22e >2014-01-30 08:04:29,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6a80d91 >2014-01-30 08:04:30,020 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6a80d91 >2014-01-30 08:04:30,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 535fef9d >2014-01-30 08:04:30,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 535fef9d >2014-01-30 08:04:32,381 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) [79e57d6f] No up server in cluster >2014-01-30 08:04:32,381 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:04:32,385 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) [79e57d6f] No up server in cluster >2014-01-30 08:04:32,385 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:04:32,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 3bfba530 >2014-01-30 08:04:32,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 3bfba530 >2014-01-30 08:04:32,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 77b11b5a >2014-01-30 08:04:33,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterTasksListVDSCommand, return: [], log id: 77b11b5a >2014-01-30 08:04:35,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d901f34 >2014-01-30 08:04:35,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2d901f34 >2014-01-30 08:04:35,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2cac1a43 >2014-01-30 08:04:36,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c450d0c2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@486739e7}, log id: 2cac1a43 >2014-01-30 08:04:36,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2ad68e60 >2014-01-30 08:04:36,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2ad68e60 >2014-01-30 08:04:36,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3a4caf94 >2014-01-30 08:04:36,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3a4caf94 >2014-01-30 08:04:41,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 165dfa65 >2014-01-30 08:04:42,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 165dfa65 >2014-01-30 08:04:42,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b610dd3 >2014-01-30 08:04:42,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c706b16, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33a04751}, log id: 2b610dd3 >2014-01-30 08:04:42,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 57d18d1b >2014-01-30 08:04:43,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 57d18d1b >2014-01-30 08:04:43,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 54489e4c >2014-01-30 08:04:43,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54489e4c >2014-01-30 08:04:48,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c79a8d9 >2014-01-30 08:04:48,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7c79a8d9 >2014-01-30 08:04:48,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 361aaa54 >2014-01-30 08:04:49,175 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34a2813e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fdf79174}, log id: 361aaa54 >2014-01-30 08:04:49,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1e9b8c5e >2014-01-30 08:04:49,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1e9b8c5e >2014-01-30 08:04:49,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 40666d42 >2014-01-30 08:04:49,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 40666d42 >2014-01-30 08:04:54,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 449b751a >2014-01-30 08:04:55,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 449b751a >2014-01-30 08:04:55,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2196576f >2014-01-30 08:04:55,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b3dc921, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84676ca9}, log id: 2196576f >2014-01-30 08:04:55,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: d0390a8 >2014-01-30 08:04:56,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: d0390a8 >2014-01-30 08:04:56,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 481f2005 >2014-01-30 08:04:56,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 481f2005 >2014-01-30 08:05:01,510 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a4a9d46 >2014-01-30 08:05:01,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2a4a9d46 >2014-01-30 08:05:01,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4192111c >2014-01-30 08:05:02,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f95edfd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@41eeff5a}, log id: 4192111c >2014-01-30 08:05:02,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7fdf7a4f >2014-01-30 08:05:02,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7fdf7a4f >2014-01-30 08:05:02,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7f42a419 >2014-01-30 08:05:03,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7f42a419 >2014-01-30 08:05:08,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 691894cb >2014-01-30 08:05:08,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 691894cb >2014-01-30 08:05:08,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a961496 >2014-01-30 08:05:08,807 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e33e6f16, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dad95d7c}, log id: 7a961496 >2014-01-30 08:05:08,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 119bb898 >2014-01-30 08:05:09,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 119bb898 >2014-01-30 08:05:09,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 720f352c >2014-01-30 08:05:09,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 720f352c >2014-01-30 08:05:14,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 39f202b >2014-01-30 08:05:15,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 39f202b >2014-01-30 08:05:15,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3665422d >2014-01-30 08:05:15,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e843fe7f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de16359e}, log id: 3665422d >2014-01-30 08:05:15,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 76941536 >2014-01-30 08:05:15,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 76941536 >2014-01-30 08:05:15,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1a4cd6ae >2014-01-30 08:05:16,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1a4cd6ae >2014-01-30 08:05:18,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 4ee84c8a >2014-01-30 08:05:18,357 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@3abe0a33, log id: 4ee84c8a >2014-01-30 08:05:18,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 128fb866 >2014-01-30 08:05:18,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@726d4e2c, log id: 128fb866 >2014-01-30 08:05:21,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 55f30213 >2014-01-30 08:05:21,665 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 55f30213 >2014-01-30 08:05:21,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b95a7aa >2014-01-30 08:05:21,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1324d8d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10fd7cbe}, log id: 5b95a7aa >2014-01-30 08:05:21,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 48a6ea49 >2014-01-30 08:05:22,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 48a6ea49 >2014-01-30 08:05:22,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 24f08f66 >2014-01-30 08:05:22,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 24f08f66 >2014-01-30 08:05:27,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7fce22f >2014-01-30 08:05:28,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7fce22f >2014-01-30 08:05:28,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1924cd54 >2014-01-30 08:05:28,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a0fbfb0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aeefbd69}, log id: 1924cd54 >2014-01-30 08:05:28,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: aaefbd0 >2014-01-30 08:05:29,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: aaefbd0 >2014-01-30 08:05:29,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 67c3af27 >2014-01-30 08:05:29,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 67c3af27 >2014-01-30 08:05:33,232 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] No up server in cluster >2014-01-30 08:05:33,232 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:05:33,235 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] No up server in cluster >2014-01-30 08:05:33,235 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:05:33,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 744b6e2e >2014-01-30 08:05:33,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 744b6e2e >2014-01-30 08:05:33,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 254379f3 >2014-01-30 08:05:34,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterTasksListVDSCommand, return: [], log id: 254379f3 >2014-01-30 08:05:34,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60974dbb >2014-01-30 08:05:34,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 60974dbb >2014-01-30 08:05:34,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36403168 >2014-01-30 08:05:35,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6efc11e5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f7ed2e4}, log id: 36403168 >2014-01-30 08:05:35,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 53f6378f >2014-01-30 08:05:35,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 53f6378f >2014-01-30 08:05:35,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 79036ff3 >2014-01-30 08:05:35,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 79036ff3 >2014-01-30 08:05:40,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: dfd1713 >2014-01-30 08:05:41,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: dfd1713 >2014-01-30 08:05:41,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49adbea >2014-01-30 08:05:41,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92b21daf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45baf46}, log id: 49adbea >2014-01-30 08:05:41,701 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6839f8cb >2014-01-30 08:05:42,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6839f8cb >2014-01-30 08:05:42,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 61ca7423 >2014-01-30 08:05:42,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 61ca7423 >2014-01-30 08:05:47,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3294de4 >2014-01-30 08:05:47,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3294de4 >2014-01-30 08:05:47,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43fd3827 >2014-01-30 08:05:48,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8950fbf2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39470414}, log id: 43fd3827 >2014-01-30 08:05:48,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 38710186 >2014-01-30 08:05:48,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 38710186 >2014-01-30 08:05:48,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5203c814 >2014-01-30 08:05:48,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5203c814 >2014-01-30 08:05:54,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 754e7036 >2014-01-30 08:05:54,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 754e7036 >2014-01-30 08:05:54,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b4b04e2 >2014-01-30 08:05:54,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea1d36b2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0a2a3dc}, log id: 6b4b04e2 >2014-01-30 08:05:54,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7e159ba7 >2014-01-30 08:05:55,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7e159ba7 >2014-01-30 08:05:55,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 57b56de2 >2014-01-30 08:05:55,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57b56de2 >2014-01-30 08:06:00,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1490b384 >2014-01-30 08:06:01,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1490b384 >2014-01-30 08:06:01,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 224bdc34 >2014-01-30 08:06:01,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@245409e2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2974e41c}, log id: 224bdc34 >2014-01-30 08:06:01,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4bcf5041 >2014-01-30 08:06:01,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4bcf5041 >2014-01-30 08:06:01,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3d0d9ade >2014-01-30 08:06:02,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3d0d9ade >2014-01-30 08:06:07,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f4a0db2 >2014-01-30 08:06:07,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6f4a0db2 >2014-01-30 08:06:07,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1355cb53 >2014-01-30 08:06:07,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d085cbc1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1c5859}, log id: 1355cb53 >2014-01-30 08:06:07,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 52e35638 >2014-01-30 08:06:08,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 52e35638 >2014-01-30 08:06:08,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5a795e8 >2014-01-30 08:06:08,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5a795e8 >2014-01-30 08:06:13,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60e7843c >2014-01-30 08:06:14,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 60e7843c >2014-01-30 08:06:14,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f286d97 >2014-01-30 08:06:14,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22a797a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@830e4a8}, log id: 7f286d97 >2014-01-30 08:06:14,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7be07fc3 >2014-01-30 08:06:14,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7be07fc3 >2014-01-30 08:06:14,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 363aec3c >2014-01-30 08:06:15,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 363aec3c >2014-01-30 08:06:20,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1907cee2 >2014-01-30 08:06:20,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1907cee2 >2014-01-30 08:06:20,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 55c4e94f >2014-01-30 08:06:20,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5f8b27, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8efc8921}, log id: 55c4e94f >2014-01-30 08:06:20,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1cb4bef6 >2014-01-30 08:06:21,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1cb4bef6 >2014-01-30 08:06:21,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3fc61a12 >2014-01-30 08:06:21,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3fc61a12 >2014-01-30 08:06:26,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 549ce733 >2014-01-30 08:06:27,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 549ce733 >2014-01-30 08:06:27,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56d8dcfe >2014-01-30 08:06:27,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@540cf2c7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a607dd}, log id: 56d8dcfe >2014-01-30 08:06:27,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2e139fe2 >2014-01-30 08:06:27,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 2e139fe2 >2014-01-30 08:06:27,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6a9c082f >2014-01-30 08:06:28,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 6a9c082f >2014-01-30 08:06:33,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: def168a >2014-01-30 08:06:33,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: def168a >2014-01-30 08:06:33,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4eadd28a >2014-01-30 08:06:33,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a266a8a5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@784e4c76}, log id: 4eadd28a >2014-01-30 08:06:34,034 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 67bbbeb3 >2014-01-30 08:06:34,079 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-91) [51ec2212] No up server in cluster >2014-01-30 08:06:34,080 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-91) [51ec2212] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:06:34,081 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-91) [51ec2212] No up server in cluster >2014-01-30 08:06:34,082 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-91) [51ec2212] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:06:34,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 6053edf2 >2014-01-30 08:06:34,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 67bbbeb3 >2014-01-30 08:06:34,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1007cfc7 >2014-01-30 08:06:34,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 6053edf2 >2014-01-30 08:06:34,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 40d424b6 >2014-01-30 08:06:34,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1007cfc7 >2014-01-30 08:06:34,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterTasksListVDSCommand, return: [], log id: 40d424b6 >2014-01-30 08:06:39,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 535b5c18 >2014-01-30 08:06:40,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 535b5c18 >2014-01-30 08:06:40,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2fe7f764 >2014-01-30 08:06:40,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79434fe2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe77f3d7}, log id: 2fe7f764 >2014-01-30 08:06:40,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5a0124cb >2014-01-30 08:06:41,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5a0124cb >2014-01-30 08:06:41,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 13f4bc44 >2014-01-30 08:06:41,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 13f4bc44 >2014-01-30 08:06:46,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 73d655be >2014-01-30 08:06:46,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 73d655be >2014-01-30 08:06:46,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 263d2e91 >2014-01-30 08:06:47,076 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf6be9e8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49142d29}, log id: 263d2e91 >2014-01-30 08:06:47,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 14a8b942 >2014-01-30 08:06:47,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 14a8b942 >2014-01-30 08:06:47,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7c36f20b >2014-01-30 08:06:47,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 7c36f20b >2014-01-30 08:06:52,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: adcdb9b >2014-01-30 08:06:53,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: adcdb9b >2014-01-30 08:06:53,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a14ae7b >2014-01-30 08:06:53,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da8a5be1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3836aa89}, log id: 2a14ae7b >2014-01-30 08:06:53,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7381fd95 >2014-01-30 08:06:54,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7381fd95 >2014-01-30 08:06:54,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 9f6579 >2014-01-30 08:06:54,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9f6579 >2014-01-30 08:06:59,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3385355b >2014-01-30 08:06:59,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3385355b >2014-01-30 08:06:59,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52f075b7 >2014-01-30 08:07:00,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3713c219, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@993ad2dd}, log id: 52f075b7 >2014-01-30 08:07:00,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 70b82690 >2014-01-30 08:07:00,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 70b82690 >2014-01-30 08:07:00,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 55997ce5 >2014-01-30 08:07:00,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 55997ce5 >2014-01-30 08:07:05,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4684e0b8 >2014-01-30 08:07:06,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4684e0b8 >2014-01-30 08:07:06,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5bd477ec >2014-01-30 08:07:06,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f04d1e02, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3161d1df}, log id: 5bd477ec >2014-01-30 08:07:06,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 78ce5fbc >2014-01-30 08:07:07,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 78ce5fbc >2014-01-30 08:07:07,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 326d350a >2014-01-30 08:07:07,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 326d350a >2014-01-30 08:07:12,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 171badda >2014-01-30 08:07:13,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 171badda >2014-01-30 08:07:13,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ea57db4 >2014-01-30 08:07:13,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2da654c2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7627cccb}, log id: 6ea57db4 >2014-01-30 08:07:13,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7be343aa >2014-01-30 08:07:13,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7be343aa >2014-01-30 08:07:13,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 309e9a18 >2014-01-30 08:07:14,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 309e9a18 >2014-01-30 08:07:19,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 416b97e0 >2014-01-30 08:07:19,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 416b97e0 >2014-01-30 08:07:19,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ade29a5 >2014-01-30 08:07:19,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@acaa0279, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@358926fb}, log id: 3ade29a5 >2014-01-30 08:07:19,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5dac8a5b >2014-01-30 08:07:20,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5dac8a5b >2014-01-30 08:07:20,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 980856b >2014-01-30 08:07:20,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 980856b >2014-01-30 08:07:25,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 491db8f2 >2014-01-30 08:07:26,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 491db8f2 >2014-01-30 08:07:26,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 364da983 >2014-01-30 08:07:26,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61c56944, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9e60ed0}, log id: 364da983 >2014-01-30 08:07:26,440 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 103578b1 >2014-01-30 08:07:26,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 103578b1 >2014-01-30 08:07:26,911 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1792e48d >2014-01-30 08:07:27,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 1792e48d >2014-01-30 08:07:32,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27844d7d >2014-01-30 08:07:32,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 27844d7d >2014-01-30 08:07:32,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 259ebb0 >2014-01-30 08:07:32,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@847ceab6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa4ff3fc}, log id: 259ebb0 >2014-01-30 08:07:32,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3b47f7bf >2014-01-30 08:07:33,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3b47f7bf >2014-01-30 08:07:33,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 2bb8d921 >2014-01-30 08:07:33,716 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 2bb8d921 >2014-01-30 08:07:34,840 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-48) [4e07496f] No up server in cluster >2014-01-30 08:07:34,841 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-48) [4e07496f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:07:34,843 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-48) [4e07496f] No up server in cluster >2014-01-30 08:07:34,843 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-48) [4e07496f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:07:34,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 14584459 >2014-01-30 08:07:35,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 14584459 >2014-01-30 08:07:35,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6299c6c0 >2014-01-30 08:07:35,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterTasksListVDSCommand, return: [], log id: 6299c6c0 >2014-01-30 08:07:38,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f1de56 >2014-01-30 08:07:39,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1f1de56 >2014-01-30 08:07:39,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c2c7475 >2014-01-30 08:07:39,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6736f685, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f427ea30}, log id: 5c2c7475 >2014-01-30 08:07:39,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 291d5101 >2014-01-30 08:07:40,007 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 291d5101 >2014-01-30 08:07:40,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5527518d >2014-01-30 08:07:40,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5527518d >2014-01-30 08:07:45,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7aba3cd8 >2014-01-30 08:07:45,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7aba3cd8 >2014-01-30 08:07:45,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: eb38707 >2014-01-30 08:07:46,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e8990a9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98a4f175}, log id: eb38707 >2014-01-30 08:07:46,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: a35edde >2014-01-30 08:07:46,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: a35edde >2014-01-30 08:07:46,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 15841903 >2014-01-30 08:07:46,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 15841903 >2014-01-30 08:07:51,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d5ea73f >2014-01-30 08:07:52,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7d5ea73f >2014-01-30 08:07:52,388 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d53c511 >2014-01-30 08:07:52,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44f09d48, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2435c631}, log id: 7d53c511 >2014-01-30 08:07:52,705 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 12772591 >2014-01-30 08:07:53,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 12772591 >2014-01-30 08:07:53,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 38d1d5a6 >2014-01-30 08:07:53,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 38d1d5a6 >2014-01-30 08:07:58,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a093061 >2014-01-30 08:07:58,939 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6a093061 >2014-01-30 08:07:58,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67c37c5 >2014-01-30 08:07:59,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5d4b29a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@150b3e78}, log id: 67c37c5 >2014-01-30 08:07:59,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3b7cfad1 >2014-01-30 08:07:59,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3b7cfad1 >2014-01-30 08:07:59,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 35b3738f >2014-01-30 08:07:59,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 35b3738f >2014-01-30 08:08:04,990 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11b1bf7d >2014-01-30 08:08:05,478 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 11b1bf7d >2014-01-30 08:08:05,486 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d9b533c >2014-01-30 08:08:05,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e0fb54a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3ed74e0}, log id: 4d9b533c >2014-01-30 08:08:05,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 593b205e >2014-01-30 08:08:06,303 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 593b205e >2014-01-30 08:08:06,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 9958bb2 >2014-01-30 08:08:06,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 9958bb2 >2014-01-30 08:08:11,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54439b95 >2014-01-30 08:08:12,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 54439b95 >2014-01-30 08:08:12,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2720a56e >2014-01-30 08:08:12,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4feb34eb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d19374e}, log id: 2720a56e >2014-01-30 08:08:12,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3a48a626 >2014-01-30 08:08:12,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 3a48a626 >2014-01-30 08:08:12,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 54a1531d >2014-01-30 08:08:13,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 54a1531d >2014-01-30 08:08:18,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2daa0665 >2014-01-30 08:08:18,636 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2daa0665 >2014-01-30 08:08:18,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1fb25f60 >2014-01-30 08:08:18,910 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c86e21af, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd223d7}, log id: 1fb25f60 >2014-01-30 08:08:18,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4a741fbb >2014-01-30 08:08:19,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4a741fbb >2014-01-30 08:08:19,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3bcfd408 >2014-01-30 08:08:19,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3bcfd408 >2014-01-30 08:08:24,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ddee0af >2014-01-30 08:08:25,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4ddee0af >2014-01-30 08:08:25,211 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d786bb9 >2014-01-30 08:08:25,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71898fc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc0871c2}, log id: 5d786bb9 >2014-01-30 08:08:25,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4d4adef8 >2014-01-30 08:08:25,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4d4adef8 >2014-01-30 08:08:25,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4136adc8 >2014-01-30 08:08:26,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4136adc8 >2014-01-30 08:08:31,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e96c877 >2014-01-30 08:08:31,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6e96c877 >2014-01-30 08:08:31,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29ef764e >2014-01-30 08:08:32,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0982257, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4384e704}, log id: 29ef764e >2014-01-30 08:08:32,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 6427de0a >2014-01-30 08:08:32,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 6427de0a >2014-01-30 08:08:32,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 17b57e2 >2014-01-30 08:08:32,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 17b57e2 >2014-01-30 08:08:35,660 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-84) [2ccca513] No up server in cluster >2014-01-30 08:08:35,661 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-84) [2ccca513] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:08:35,663 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-84) [2ccca513] No up server in cluster >2014-01-30 08:08:35,663 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-84) [2ccca513] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:08:35,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 555ce13d >2014-01-30 08:08:36,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 555ce13d >2014-01-30 08:08:36,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterTasksListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7137366a >2014-01-30 08:08:36,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterTasksListVDSCommand, return: [], log id: 7137366a >2014-01-30 08:08:37,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f70a7b >2014-01-30 08:08:38,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: f70a7b >2014-01-30 08:08:38,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6dc630aa >2014-01-30 08:08:38,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9be5248, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@681b4076}, log id: 6dc630aa >2014-01-30 08:08:38,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 65e61bd4 >2014-01-30 08:08:39,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 65e61bd4 >2014-01-30 08:08:39,108 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 719c0552 >2014-01-30 08:08:39,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 719c0552 >2014-01-30 08:08:44,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d94a9d3 >2014-01-30 08:08:44,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7d94a9d3 >2014-01-30 08:08:44,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 199e653c >2014-01-30 08:08:45,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@deea8d9a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42cc7f7d}, log id: 199e653c >2014-01-30 08:08:45,197 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7305860f >2014-01-30 08:08:45,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7305860f >2014-01-30 08:08:45,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 3e16315a >2014-01-30 08:08:45,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 3e16315a >2014-01-30 08:08:50,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27be1a80 >2014-01-30 08:08:51,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 27be1a80 >2014-01-30 08:08:51,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2af812ff >2014-01-30 08:08:51,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7416e4b5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@964aa03b}, log id: 2af812ff >2014-01-30 08:08:51,752 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 10bc9d35 >2014-01-30 08:08:52,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 10bc9d35 >2014-01-30 08:08:52,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 63c8e951 >2014-01-30 08:08:52,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 63c8e951 >2014-01-30 08:08:57,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d5fdde1 >2014-01-30 08:08:57,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: d5fdde1 >2014-01-30 08:08:57,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 138a32d7 >2014-01-30 08:08:58,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff04a90b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3e79d5a}, log id: 138a32d7 >2014-01-30 08:08:58,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7dcdd9dd >2014-01-30 08:08:58,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7dcdd9dd >2014-01-30 08:08:58,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 39cf7bab >2014-01-30 08:08:59,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 39cf7bab >2014-01-30 08:09:04,055 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53f94dbc >2014-01-30 08:09:04,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 53f94dbc >2014-01-30 08:09:04,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50019358 >2014-01-30 08:09:04,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6eed28d1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@267121e4}, log id: 50019358 >2014-01-30 08:09:04,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5e0bad61 >2014-01-30 08:09:05,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 5e0bad61 >2014-01-30 08:09:05,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 57f5fd90 >2014-01-30 08:09:05,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 57f5fd90 >2014-01-30 08:09:10,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b134e09 >2014-01-30 08:09:11,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3b134e09 >2014-01-30 08:09:11,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2cad8e54 >2014-01-30 08:09:11,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7089df3b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c84f0210}, log id: 2cad8e54 >2014-01-30 08:09:11,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: ea950af >2014-01-30 08:09:11,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: ea950af >2014-01-30 08:09:11,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 25003313 >2014-01-30 08:09:12,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 25003313 >2014-01-30 08:09:17,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ecb1238 >2014-01-30 08:09:17,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5ecb1238 >2014-01-30 08:09:17,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ddd48bf >2014-01-30 08:09:17,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2e93943, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0d6553a}, log id: 7ddd48bf >2014-01-30 08:09:17,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4a987ae7 >2014-01-30 08:09:18,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 4a987ae7 >2014-01-30 08:09:18,451 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 347deb9d >2014-01-30 08:09:18,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 347deb9d >2014-01-30 08:09:23,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41b670cf >2014-01-30 08:09:24,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 41b670cf >2014-01-30 08:09:24,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13eca96d >2014-01-30 08:09:24,485 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30c86cec, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67a064a9}, log id: 13eca96d >2014-01-30 08:09:24,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1cafa033 >2014-01-30 08:09:24,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 1cafa033 >2014-01-30 08:09:24,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 523810cc >2014-01-30 08:09:25,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 523810cc >2014-01-30 08:09:30,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 510c827c >2014-01-30 08:09:30,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 510c827c >2014-01-30 08:09:30,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5fafa6a >2014-01-30 08:09:31,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69a384cc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32a238a3}, log id: 5fafa6a >2014-01-30 08:09:31,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: af62bb4 >2014-01-30 08:09:31,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: af62bb4 >2014-01-30 08:09:31,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 4ac6c15c >2014-01-30 08:09:31,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 4ac6c15c >2014-01-30 08:09:36,521 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2014-01-30 08:09:36,521 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:09:36,525 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2014-01-30 08:09:36,525 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:09:36,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21d0c601 >2014-01-30 08:09:36,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d325064 >2014-01-30 08:09:37,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 21d0c601 >2014-01-30 08:09:37,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 7e4c4312 >2014-01-30 08:09:37,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5d325064 >2014-01-30 08:09:37,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d1b332d >2014-01-30 08:09:37,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [], log id: 7e4c4312 >2014-01-30 08:09:37,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77afdaa0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1dc227d}, log id: 7d1b332d >2014-01-30 08:09:37,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 7f518e42 >2014-01-30 08:09:38,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.216:CONNECTED, 10.70.37.149:CONNECTED], log id: 7f518e42 >2014-01-30 08:09:38,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 5909c8e1 >2014-01-30 08:09:38,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {}, log id: 5909c8e1 >2014-01-30 08:09:43,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 491ae9ab >2014-01-30 08:09:43,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 491ae9ab >2014-01-30 08:09:43,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2df3fceb >2014-01-30 08:09:44,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4f3e319, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4af5725e}, log id: 2df3fceb >2014-01-30 08:09:44,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 254b9968 >2014-01-30 08:09:44,195 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] Command GlusterServersListVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-01-30 08:09:44,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, log id: 254b9968 >2014-01-30 08:09:44,195 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-80) [992a9f] Error while refreshing server data for cluster test_3 from database!: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused (Failed with error VDS_NETWORK_ERROR and code 5022) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterJob.fetchServers(GlusterJob.java:55) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.fetchServers(GlusterSyncJob.java:318) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.fetchServers(GlusterSyncJob.java:259) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshServerData(GlusterSyncJob.java:136) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterData(GlusterSyncJob.java:106) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshLightWeightData(GlusterSyncJob.java:86) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:09:44,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: bd3e4b8 >2014-01-30 08:09:44,201 ERROR [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] Command GlusterVolumesListVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-01-30 08:09:44,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, log id: bd3e4b8 >2014-01-30 08:09:44,201 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-80) [992a9f] Error while refreshing Gluster lightweight data of cluster test_3!: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused (Failed with error VDS_NETWORK_ERROR and code 5022) > at org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:122) [bll.jar:] > at org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.RunVdsCommand(VDSBrokerFrontendImpl.java:33) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterJob.runVdsCommand(GlusterJob.java:65) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.fetchVolumes(GlusterSyncJob.java:406) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.fetchVolumes(GlusterSyncJob.java:392) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshVolumeData(GlusterSyncJob.java:363) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterData(GlusterSyncJob.java:107) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshLightWeightData(GlusterSyncJob.java:86) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:09:44,269 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (DefaultQuartzScheduler_Worker-69) Command GetStatsVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-01-30 08:09:44,270 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-69) vds::refreshVdsStats Failed getVdsStats, vds = 45e42dfd-602d-47ea-ad35-9ee3ce83655e : 10.70.37.158, error = VDSNetworkException: java.net.ConnectException: Connection refused >2014-01-30 08:09:44,277 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-69) Failed to refresh VDS , vds = 45e42dfd-602d-47ea-ad35-9ee3ce83655e : 10.70.37.158, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-01-30 08:09:47,284 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-01-30 08:09:47,287 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-26) [7a78e8e] Failed to refresh VDS , vds = 45e42dfd-602d-47ea-ad35-9ee3ce83655e : 10.70.37.158, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-01-30 08:09:47,759 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetStatsVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] Command GetStatsVDS execution failed. Exception: VDSNetworkException: java.net.SocketException: Connection reset >2014-01-30 08:09:47,760 ERROR [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] vds::refreshVdsStats Failed getVdsStats, vds = 93ecedfe-3409-43cf-a0b2-b2247948eb75 : host1, error = VDSNetworkException: java.net.SocketException: Connection reset >2014-01-30 08:09:47,767 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] Failed to refresh VDS , vds = 93ecedfe-3409-43cf-a0b2-b2247948eb75 : host1, VDS Network Error, continuing. >java.net.SocketException: Connection reset >2014-01-30 08:09:49,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 610342e3 >2014-01-30 08:09:49,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 610342e3 >2014-01-30 08:09:49,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f052ad5 >2014-01-30 08:09:49,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7be82f2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7ab50435}, log id: 3f052ad5 >2014-01-30 08:09:50,297 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-01-30 08:09:50,302 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] Failed to refresh VDS , vds = 45e42dfd-602d-47ea-ad35-9ee3ce83655e : 10.70.37.158, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-01-30 08:09:50,777 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-01-30 08:09:50,781 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Failed to refresh VDS , vds = 93ecedfe-3409-43cf-a0b2-b2247948eb75 : host1, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-01-30 08:09:53,790 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-39) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-01-30 08:09:53,794 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-39) Failed to refresh VDS , vds = 93ecedfe-3409-43cf-a0b2-b2247948eb75 : host1, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-01-30 08:09:55,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b6028ab >2014-01-30 08:09:55,316 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:09:55,319 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-63) [1d6d6076] Failed to refresh VDS , vds = 45e42dfd-602d-47ea-ad35-9ee3ce83655e : 10.70.37.158, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 08:09:55,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6b6028ab >2014-01-30 08:09:55,520 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 45ccd9bc >2014-01-30 08:09:55,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b30141f7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6013220b}, log id: 45ccd9bc >2014-01-30 08:09:56,802 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused >2014-01-30 08:09:56,805 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Failed to refresh VDS , vds = 93ecedfe-3409-43cf-a0b2-b2247948eb75 : host1, VDS Network Error, continuing. >java.net.ConnectException: Connection refused >2014-01-30 08:10:00,330 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:00,335 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-16) [2c713cf8] Failed to refresh VDS , vds = 45e42dfd-602d-47ea-ad35-9ee3ce83655e : 10.70.37.158, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:00,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15f35cea >2014-01-30 08:10:01,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 15f35cea >2014-01-30 08:10:01,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b2a5e55 >2014-01-30 08:10:01,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9c32565, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e01a9491}, log id: 1b2a5e55 >2014-01-30 08:10:01,812 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:01,816 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-42) [cab85f1] Failed to refresh VDS , vds = 93ecedfe-3409-43cf-a0b2-b2247948eb75 : host1, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:05,346 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:05,349 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-57) [4166d263] Failed to refresh VDS , vds = 45e42dfd-602d-47ea-ad35-9ee3ce83655e : 10.70.37.158, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:06,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 47b69cf8 >2014-01-30 08:10:06,823 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:06,827 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-77) [7c43042] Failed to refresh VDS , vds = 93ecedfe-3409-43cf-a0b2-b2247948eb75 : host1, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:07,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 47b69cf8 >2014-01-30 08:10:07,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 47d80b9c >2014-01-30 08:10:07,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f59aeb0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@979ea204}, log id: 47d80b9c >2014-01-30 08:10:10,360 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:10,363 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-62) [1449451c] Failed to refresh VDS , vds = 45e42dfd-602d-47ea-ad35-9ee3ce83655e : 10.70.37.158, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:11,839 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:11,844 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-11) [7cc81051] Failed to refresh VDS , vds = 93ecedfe-3409-43cf-a0b2-b2247948eb75 : host1, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:12,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d715ebb >2014-01-30 08:10:12,938 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1d715ebb >2014-01-30 08:10:12,945 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6222febb >2014-01-30 08:10:13,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9e10beb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e6622e2}, log id: 6222febb >2014-01-30 08:10:15,374 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:15,378 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Failed to refresh VDS , vds = 45e42dfd-602d-47ea-ad35-9ee3ce83655e : 10.70.37.158, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:16,855 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:16,860 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-28) [3472ce94] Failed to refresh VDS , vds = 93ecedfe-3409-43cf-a0b2-b2247948eb75 : host1, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:18,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d60d791 >2014-01-30 08:10:18,652 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 08:10:18,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1d60d791 >2014-01-30 08:10:18,763 INFO [org.ovirt.engine.core.bll.lock.InMemoryLockManager] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Failed to acquire lock and wait lock EngineLock [exclusiveLocks= key: 80f5d6fc-c5b2-4936-b18c-e0ef2be46930 value: GLUSTER >, sharedLocks= ] >2014-01-30 08:10:18,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 419a22c4 >2014-01-30 08:10:19,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89d5c398, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cebc24ae}, log id: 419a22c4 >2014-01-30 08:10:19,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 1155d14c >2014-01-30 08:10:19,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1899e58, log id: 1155d14c >2014-01-30 08:10:19,341 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 71faa431 >2014-01-30 08:10:19,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@557e69b0, log id: 71faa431 >2014-01-30 08:10:20,389 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:20,394 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-9) [23554188] Failed to refresh VDS , vds = 45e42dfd-602d-47ea-ad35-9ee3ce83655e : 10.70.37.158, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:21,868 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-20) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:21,873 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-20) Failed to refresh VDS , vds = 93ecedfe-3409-43cf-a0b2-b2247948eb75 : host1, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:24,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74ebc7b2 >2014-01-30 08:10:24,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 74ebc7b2 >2014-01-30 08:10:24,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30c73eab >2014-01-30 08:10:24,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3969f6db, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@787571c}, log id: 30c73eab >2014-01-30 08:10:25,406 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:25,411 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-6) [68531e72] Failed to refresh VDS , vds = 45e42dfd-602d-47ea-ad35-9ee3ce83655e : 10.70.37.158, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:26,884 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:26,889 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-59) [499ce58b] Failed to refresh VDS , vds = 93ecedfe-3409-43cf-a0b2-b2247948eb75 : host1, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:29,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49ab71cc >2014-01-30 08:10:30,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 49ab71cc >2014-01-30 08:10:30,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5551f8d2 >2014-01-30 08:10:30,420 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:30,423 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] Failed to refresh VDS , vds = 45e42dfd-602d-47ea-ad35-9ee3ce83655e : 10.70.37.158, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:30,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8b638ac, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bacc997}, log id: 5551f8d2 >2014-01-30 08:10:31,899 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:31,903 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-71) [1ac2212e] Failed to refresh VDS , vds = 93ecedfe-3409-43cf-a0b2-b2247948eb75 : host1, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:35,434 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:35,438 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-70) Failed to refresh VDS , vds = 45e42dfd-602d-47ea-ad35-9ee3ce83655e : 10.70.37.158, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:35,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f09c3a2 >2014-01-30 08:10:36,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7f09c3a2 >2014-01-30 08:10:36,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26c1d8d5 >2014-01-30 08:10:36,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7206f8f6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@461784ab}, log id: 26c1d8d5 >2014-01-30 08:10:36,912 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-50) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:36,917 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-50) Failed to refresh VDS , vds = 93ecedfe-3409-43cf-a0b2-b2247948eb75 : host1, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:37,355 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-34) [4af86af0] No up server in cluster >2014-01-30 08:10:37,356 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-34) [4af86af0] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:10:37,359 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-34) [4af86af0] No up server in cluster >2014-01-30 08:10:37,359 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-34) [4af86af0] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:10:37,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 48370360 >2014-01-30 08:10:37,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 48370360 >2014-01-30 08:10:37,909 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-34) [4af86af0] No up server in cluster >2014-01-30 08:10:37,910 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-34) [4af86af0] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:10:40,448 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:40,452 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] Failed to refresh VDS , vds = 45e42dfd-602d-47ea-ad35-9ee3ce83655e : 10.70.37.158, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:41,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6914914f >2014-01-30 08:10:41,928 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:41,932 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-64) [4dd3051e] Failed to refresh VDS , vds = 93ecedfe-3409-43cf-a0b2-b2247948eb75 : host1, VDS Network Error, continuing. >java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:42,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6914914f >2014-01-30 08:10:42,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9467368 >2014-01-30 08:10:42,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88ac6437, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c43a3a0}, log id: 9467368 >2014-01-30 08:10:45,471 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:45,471 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Server failed to respond, vds_id = 45e42dfd-602d-47ea-ad35-9ee3ce83655e, vds_name = 10.70.37.158, vm_count = 0, spm_status = None, non-responsive_timeout (seconds) = 60, error = java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:45,479 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Correlation ID: null, Call Stack: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.SocketTimeoutException: connect timed out > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:102) > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:28) > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:532) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:485) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.Refresh(VdsUpdateRunTimeInfo.java:336) > at org.ovirt.engine.core.vdsbroker.VdsManager.OnTimer(VdsManager.java:235) > at sun.reflect.GeneratedMethodAccessor56.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) >Caused by: java.net.SocketTimeoutException: connect timed out > at java.net.PlainSocketImpl.socketConnect(Native Method) > at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) > at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) > at java.net.Socket.connect(Socket.java:579) > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) > at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707) > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionManager.java:1361) > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387) > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) > at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397) > at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323) > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) > at com.sun.proxy.$Proxy113.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:225) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Host 10.70.37.158 is non responsive. >2014-01-30 08:10:45,480 INFO [org.ovirt.engine.core.bll.VdsEventListener] (pool-5-thread-37) [9ebfc1e] ResourceManager::vdsNotResponding entered for Host 45e42dfd-602d-47ea-ad35-9ee3ce83655e, 10.70.37.158 >2014-01-30 08:10:45,512 INFO [org.ovirt.engine.core.bll.SshSoftFencingCommand] (pool-5-thread-37) [620d9fc5] Running command: SshSoftFencingCommand internal: true. Entities affected : ID: 45e42dfd-602d-47ea-ad35-9ee3ce83655e Type: VDS >2014-01-30 08:10:46,461 ERROR [org.ovirt.engine.core.bll.SshSoftFencingCommand] (pool-5-thread-37) [620d9fc5] SSH connection to host 10.70.37.158 failed: org.apache.sshd.common.RuntimeSshException: Failed to get the session.: org.apache.sshd.common.RuntimeSshException: Failed to get the session. > at org.apache.sshd.client.future.DefaultConnectFuture.getSession(DefaultConnectFuture.java:43) > at org.ovirt.engine.core.utils.ssh.SSHClient.connect(SSHClient.java:288) [utils.jar:] > at org.ovirt.engine.core.bll.utils.EngineSSHClient.connect(EngineSSHClient.java:59) [bll.jar:] > at org.ovirt.engine.core.bll.SshSoftFencingCommand.executeSshSoftFencingCommand(SshSoftFencingCommand.java:73) [bll.jar:] > at org.ovirt.engine.core.bll.SshSoftFencingCommand.executeCommand(SshSoftFencingCommand.java:43) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor84.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:235) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:374) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:218) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.VdsEventListener$1.run(VdsEventListener.java:134) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_45] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_45] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_45] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_45] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_45] >Caused by: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_45] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:735) [rt.jar:1.7.0_45] > at org.apache.mina.transport.socket.nio.NioSocketConnector.finishConnect(NioSocketConnector.java:224) [mina-core.jar:] > at org.apache.mina.transport.socket.nio.NioSocketConnector.finishConnect(NioSocketConnector.java:46) [mina-core.jar:] > at org.apache.mina.core.polling.AbstractPollingIoConnector.processConnections(AbstractPollingIoConnector.java:439) [mina-core.jar:] > at org.apache.mina.core.polling.AbstractPollingIoConnector.access$700(AbstractPollingIoConnector.java:64) [mina-core.jar:] > at org.apache.mina.core.polling.AbstractPollingIoConnector$Connector.run(AbstractPollingIoConnector.java:508) [mina-core.jar:] > at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:64) [mina-core.jar:] > ... 3 more > >2014-01-30 08:10:46,943 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:46,943 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-74) [61851da7] Server failed to respond, vds_id = 93ecedfe-3409-43cf-a0b2-b2247948eb75, vds_name = host1, vm_count = 0, spm_status = None, non-responsive_timeout (seconds) = 60, error = java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:46,955 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-74) [61851da7] Correlation ID: null, Call Stack: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.SocketTimeoutException: connect timed out > at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:102) > at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) > at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:28) > at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:532) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:485) > at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.Refresh(VdsUpdateRunTimeInfo.java:336) > at org.ovirt.engine.core.vdsbroker.VdsManager.OnTimer(VdsManager.java:235) > at sun.reflect.GeneratedMethodAccessor56.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) >Caused by: java.net.SocketTimeoutException: connect timed out > at java.net.PlainSocketImpl.socketConnect(Native Method) > at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) > at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) > at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) > at java.net.Socket.connect(Socket.java:579) > at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) > at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) > at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707) > at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionManager.java:1361) > at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387) > at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) > at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397) > at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323) > at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) > at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) > at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) > at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) > at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) > at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) > at com.sun.proxy.$Proxy113.getVdsCapabilities(Unknown Source) > at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:225) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask.run(FutureTask.java:262) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:744) >, Custom Event ID: -1, Message: Host host1 is non responsive. >2014-01-30 08:10:46,957 INFO [org.ovirt.engine.core.bll.VdsEventListener] (pool-5-thread-16) [61851da7] ResourceManager::vdsNotResponding entered for Host 93ecedfe-3409-43cf-a0b2-b2247948eb75, host1 >2014-01-30 08:10:46,981 INFO [org.ovirt.engine.core.bll.SshSoftFencingCommand] (pool-5-thread-16) [6d7360c1] Running command: SshSoftFencingCommand internal: true. Entities affected : ID: 93ecedfe-3409-43cf-a0b2-b2247948eb75 Type: VDS >2014-01-30 08:10:47,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3cc402b5 >2014-01-30 08:10:47,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3cc402b5 >2014-01-30 08:10:47,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 522ce574 >2014-01-30 08:10:47,940 ERROR [org.ovirt.engine.core.bll.SshSoftFencingCommand] (pool-5-thread-16) [6d7360c1] SSH connection to host host1 failed: org.apache.sshd.common.RuntimeSshException: Failed to get the session.: org.apache.sshd.common.RuntimeSshException: Failed to get the session. > at org.apache.sshd.client.future.DefaultConnectFuture.getSession(DefaultConnectFuture.java:43) > at org.ovirt.engine.core.utils.ssh.SSHClient.connect(SSHClient.java:288) [utils.jar:] > at org.ovirt.engine.core.bll.utils.EngineSSHClient.connect(EngineSSHClient.java:59) [bll.jar:] > at org.ovirt.engine.core.bll.SshSoftFencingCommand.executeSshSoftFencingCommand(SshSoftFencingCommand.java:73) [bll.jar:] > at org.ovirt.engine.core.bll.SshSoftFencingCommand.executeCommand(SshSoftFencingCommand.java:43) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1134) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1219) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1895) [bll.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:] > at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:] > at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1239) [bll.jar:] > at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:362) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runAction(Backend.java:416) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:395) [bll.jar:] > at org.ovirt.engine.core.bll.Backend.runInternalAction(Backend.java:636) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor84.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:58) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:52) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:235) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:374) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:218) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) [jboss-as-ejb3.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:182) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation.jar:1.1.2.Final-redhat-1] > at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) [jboss-as-ee.jar:7.2.1.Final-redhat-10] > at org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view8.runInternalAction(Unknown Source) [bll.jar:] > at org.ovirt.engine.core.bll.VdsEventListener$1.run(VdsEventListener.java:134) [bll.jar:] > at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:71) [utils.jar:] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_45] > at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_45] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_45] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_45] > at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_45] >Caused by: java.net.NoRouteToHostException: No route to host > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [rt.jar:1.7.0_45] > at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:735) [rt.jar:1.7.0_45] > at org.apache.mina.transport.socket.nio.NioSocketConnector.finishConnect(NioSocketConnector.java:224) [mina-core.jar:] > at org.apache.mina.transport.socket.nio.NioSocketConnector.finishConnect(NioSocketConnector.java:46) [mina-core.jar:] > at org.apache.mina.core.polling.AbstractPollingIoConnector.processConnections(AbstractPollingIoConnector.java:439) [mina-core.jar:] > at org.apache.mina.core.polling.AbstractPollingIoConnector.access$700(AbstractPollingIoConnector.java:64) [mina-core.jar:] > at org.apache.mina.core.polling.AbstractPollingIoConnector$Connector.run(AbstractPollingIoConnector.java:508) [mina-core.jar:] > at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:64) [mina-core.jar:] > ... 3 more > >2014-01-30 08:10:48,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8dfa35f1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27ea5786}, log id: 522ce574 >2014-01-30 08:10:50,503 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:51,983 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:53,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b5038f0 >2014-01-30 08:10:53,687 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7b5038f0 >2014-01-30 08:10:53,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f73bf8f >2014-01-30 08:10:53,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@63fbd0ee, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@afdc4cc8}, log id: 2f73bf8f >2014-01-30 08:10:55,517 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:56,998 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:10:59,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 476938c6 >2014-01-30 08:10:59,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 476938c6 >2014-01-30 08:10:59,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 622e5af9 >2014-01-30 08:10:59,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6548c0d9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c06cc97}, log id: 622e5af9 >2014-01-30 08:11:00,531 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:02,010 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:04,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d4200f0 >2014-01-30 08:11:05,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3d4200f0 >2014-01-30 08:11:05,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1427b4c2 >2014-01-30 08:11:05,542 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:05,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7646e9b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0c24f9c}, log id: 1427b4c2 >2014-01-30 08:11:07,022 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:10,554 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:10,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c5201f1 >2014-01-30 08:11:11,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: c5201f1 >2014-01-30 08:11:11,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1dd01305 >2014-01-30 08:11:11,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6a81fe8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@952553fb}, log id: 1dd01305 >2014-01-30 08:11:12,037 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:15,567 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:16,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38a80c52 >2014-01-30 08:11:16,928 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 38a80c52 >2014-01-30 08:11:16,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3559426c >2014-01-30 08:11:17,051 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-39) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:17,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@444105dc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c2ef399}, log id: 3559426c >2014-01-30 08:11:20,582 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:22,063 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:22,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36fa1e7a >2014-01-30 08:11:22,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 36fa1e7a >2014-01-30 08:11:22,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 99e084 >2014-01-30 08:11:22,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e74f96e9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@376000d9}, log id: 99e084 >2014-01-30 08:11:25,595 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:27,076 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:28,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b5624ef >2014-01-30 08:11:28,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b5624ef >2014-01-30 08:11:28,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e98771b >2014-01-30 08:11:28,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50280716, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aff97ef5}, log id: 7e98771b >2014-01-30 08:11:30,607 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:32,088 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:33,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72497136 >2014-01-30 08:11:34,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 72497136 >2014-01-30 08:11:34,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35ab1cf1 >2014-01-30 08:11:34,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@574b8eca, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13cf62fe}, log id: 35ab1cf1 >2014-01-30 08:11:35,619 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:37,100 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:37,917 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] No up server in cluster >2014-01-30 08:11:37,917 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:11:37,920 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] No up server in cluster >2014-01-30 08:11:37,920 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:11:37,922 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 4b007267 >2014-01-30 08:11:38,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4b007267 >2014-01-30 08:11:38,476 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] No up server in cluster >2014-01-30 08:11:38,476 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:11:39,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 450d34a6 >2014-01-30 08:11:39,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 450d34a6 >2014-01-30 08:11:39,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b6699b6 >2014-01-30 08:11:40,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@32d032e2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3dca957d}, log id: 1b6699b6 >2014-01-30 08:11:40,633 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:42,112 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:45,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52ef296 >2014-01-30 08:11:45,645 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:45,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 52ef296 >2014-01-30 08:11:45,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15d74719 >2014-01-30 08:11:46,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd289b94, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88c20dde}, log id: 15d74719 >2014-01-30 08:11:47,125 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:50,665 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:51,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 370ac1d5 >2014-01-30 08:11:51,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 370ac1d5 >2014-01-30 08:11:51,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27596588 >2014-01-30 08:11:51,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78fff6bd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7227d3d5}, log id: 27596588 >2014-01-30 08:11:52,147 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:55,686 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:56,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e2f3182 >2014-01-30 08:11:57,168 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:11:57,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e2f3182 >2014-01-30 08:11:57,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 114989d >2014-01-30 08:11:57,630 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba1cfeed, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a433224}, log id: 114989d >2014-01-30 08:12:00,707 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-53) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:12:02,185 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:12:02,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 310946f2 >2014-01-30 08:12:03,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 310946f2 >2014-01-30 08:12:03,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 694d55bc >2014-01-30 08:12:03,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2607bc1a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b8fb355}, log id: 694d55bc >2014-01-30 08:12:05,727 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:12:07,202 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:12:08,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d4f327e >2014-01-30 08:12:08,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2d4f327e >2014-01-30 08:12:08,915 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f9ddc4b >2014-01-30 08:12:09,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a8c08d1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7f6c083}, log id: 2f9ddc4b >2014-01-30 08:12:10,746 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:12:12,219 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:12:14,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e8ff6c6 >2014-01-30 08:12:14,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6e8ff6c6 >2014-01-30 08:12:14,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 503c04f6 >2014-01-30 08:12:14,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3015d60, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b32815d}, log id: 503c04f6 >2014-01-30 08:12:15,763 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:12:17,235 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:12:20,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5207afc4 >2014-01-30 08:12:20,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5207afc4 >2014-01-30 08:12:20,529 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d9ae6ab >2014-01-30 08:12:20,784 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:12:20,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83b8890b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@42fb722c}, log id: 2d9ae6ab >2014-01-30 08:12:22,251 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:12:25,806 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:12:25,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66df0e63 >2014-01-30 08:12:26,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 66df0e63 >2014-01-30 08:12:26,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1de0f43c >2014-01-30 08:12:26,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a37236c0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2efa5814}, log id: 1de0f43c >2014-01-30 08:12:27,271 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-20) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:12:30,827 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:12:31,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4273f095 >2014-01-30 08:12:32,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4273f095 >2014-01-30 08:12:32,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 205bf6a3 >2014-01-30 08:12:32,292 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:12:32,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a89acce, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@338f9fb4}, log id: 205bf6a3 >2014-01-30 08:12:35,846 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:12:37,313 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:12:37,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a1b83e1 >2014-01-30 08:12:37,914 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1a1b83e1 >2014-01-30 08:12:37,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32f82cc6 >2014-01-30 08:12:38,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1271529f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f142853}, log id: 32f82cc6 >2014-01-30 08:12:38,482 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-56) No up server in cluster >2014-01-30 08:12:38,482 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-56) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:12:38,485 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-56) No up server in cluster >2014-01-30 08:12:38,485 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-56) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:12:38,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f0f9438 >2014-01-30 08:12:38,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 3f0f9438 >2014-01-30 08:12:38,998 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-56) No up server in cluster >2014-01-30 08:12:38,998 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-56) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:12:40,864 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-50) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:12:42,337 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-53) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:12:43,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2296cc80 >2014-01-30 08:12:43,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2296cc80 >2014-01-30 08:12:43,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3da5695e >2014-01-30 08:12:43,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f8abefa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dde3a296}, log id: 3da5695e >2014-01-30 08:12:45,883 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:12:47,359 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:12:48,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16a36abc >2014-01-30 08:12:49,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 16a36abc >2014-01-30 08:12:49,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c39d143 >2014-01-30 08:12:49,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@953ecadc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a1a7636}, log id: 2c39d143 >2014-01-30 08:12:50,906 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:12:52,380 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:12:54,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 197fd99e >2014-01-30 08:12:55,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 197fd99e >2014-01-30 08:12:55,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 353e1a80 >2014-01-30 08:12:55,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@204f2b67, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@568dfc9d}, log id: 353e1a80 >2014-01-30 08:12:55,927 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:12:57,397 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:00,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a154f39 >2014-01-30 08:13:00,947 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:01,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a154f39 >2014-01-30 08:13:01,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b2017f6 >2014-01-30 08:13:01,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7c98ece, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6664069d}, log id: 7b2017f6 >2014-01-30 08:13:02,416 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:05,968 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:06,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ee73ff8 >2014-01-30 08:13:06,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3ee73ff8 >2014-01-30 08:13:06,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 63caeaca >2014-01-30 08:13:07,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27b2f582, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb11b7bb}, log id: 63caeaca >2014-01-30 08:13:07,437 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:10,987 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:12,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30a3706c >2014-01-30 08:13:12,455 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:12,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 30a3706c >2014-01-30 08:13:12,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e94c9f6 >2014-01-30 08:13:13,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fffdef7a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8af15df3}, log id: 5e94c9f6 >2014-01-30 08:13:16,007 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:17,470 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:18,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 75ce68bd >2014-01-30 08:13:18,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 75ce68bd >2014-01-30 08:13:18,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6dd392ae >2014-01-30 08:13:18,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8c3a592, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43b39311}, log id: 6dd392ae >2014-01-30 08:13:21,022 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-39) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:22,502 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-56) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:23,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 252ad95c >2014-01-30 08:13:24,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 252ad95c >2014-01-30 08:13:24,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3485a773 >2014-01-30 08:13:24,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8eb0248, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8de1cba1}, log id: 3485a773 >2014-01-30 08:13:26,041 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:27,521 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:29,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 308feb0e >2014-01-30 08:13:30,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 308feb0e >2014-01-30 08:13:30,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5914c6d6 >2014-01-30 08:13:30,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3b22959, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c50a97e6}, log id: 5914c6d6 >2014-01-30 08:13:31,063 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:32,541 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:35,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ff6de24 >2014-01-30 08:13:35,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7ff6de24 >2014-01-30 08:13:35,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b4a31b1 >2014-01-30 08:13:36,086 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:36,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8278996d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3745bfcf}, log id: 4b4a31b1 >2014-01-30 08:13:37,557 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:39,003 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) [79e57d6f] No up server in cluster >2014-01-30 08:13:39,004 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:13:39,007 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) [79e57d6f] No up server in cluster >2014-01-30 08:13:39,007 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:13:39,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 6c383c83 >2014-01-30 08:13:39,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 6c383c83 >2014-01-30 08:13:39,519 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-95) [79e57d6f] No up server in cluster >2014-01-30 08:13:39,519 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:13:41,102 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:41,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f061054 >2014-01-30 08:13:41,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2f061054 >2014-01-30 08:13:41,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d23dd >2014-01-30 08:13:41,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56414954, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24284e10}, log id: 5d23dd >2014-01-30 08:13:42,578 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:46,116 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:46,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77f1399d >2014-01-30 08:13:47,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 77f1399d >2014-01-30 08:13:47,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7fc3e657 >2014-01-30 08:13:47,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@984b3d3e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1fd1620c}, log id: 7fc3e657 >2014-01-30 08:13:47,592 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:51,132 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:52,609 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:52,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f291d7d >2014-01-30 08:13:53,084 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4f291d7d >2014-01-30 08:13:53,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8b7c8ea >2014-01-30 08:13:53,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@491fcbe4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2697611a}, log id: 8b7c8ea >2014-01-30 08:13:56,152 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:57,629 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:13:58,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e68f914 >2014-01-30 08:13:58,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3e68f914 >2014-01-30 08:13:58,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48936948 >2014-01-30 08:13:59,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7172aa61, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@38d99fba}, log id: 48936948 >2014-01-30 08:14:01,167 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:14:02,647 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:14:04,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 257983e3 >2014-01-30 08:14:04,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 257983e3 >2014-01-30 08:14:04,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 617e8c21 >2014-01-30 08:14:04,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@722d42f3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a18b189}, log id: 617e8c21 >2014-01-30 08:14:06,181 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:14:07,668 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:14:09,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3593ba0c >2014-01-30 08:14:10,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3593ba0c >2014-01-30 08:14:10,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 39cb259c >2014-01-30 08:14:10,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e46feb3e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b39cd0b}, log id: 39cb259c >2014-01-30 08:14:11,197 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-4) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:14:12,682 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:14:15,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36eb9a4f >2014-01-30 08:14:16,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 36eb9a4f >2014-01-30 08:14:16,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25ba30f6 >2014-01-30 08:14:16,211 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:14:16,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d47bc39d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a84c9745}, log id: 25ba30f6 >2014-01-30 08:14:17,698 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:14:21,231 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:14:21,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8b14e56 >2014-01-30 08:14:21,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 8b14e56 >2014-01-30 08:14:21,869 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a1c95ed >2014-01-30 08:14:22,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d8f8c21, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c75d6d72}, log id: 4a1c95ed >2014-01-30 08:14:22,716 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:14:26,245 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:14:27,156 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59b602c5 >2014-01-30 08:14:27,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 59b602c5 >2014-01-30 08:14:27,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: cf8893e >2014-01-30 08:14:27,734 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:14:27,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@863d636f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b6db6fd}, log id: cf8893e >2014-01-30 08:14:31,265 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:14:32,749 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:14:32,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c0ca8ce >2014-01-30 08:14:33,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4c0ca8ce >2014-01-30 08:14:33,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e8bbb05 >2014-01-30 08:14:33,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39344f95, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec225a55}, log id: 5e8bbb05 >2014-01-30 08:14:36,281 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:14:37,763 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:14:38,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3da48235 >2014-01-30 08:14:39,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3da48235 >2014-01-30 08:14:39,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33524091 >2014-01-30 08:14:39,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8e7d518, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21ff4548}, log id: 33524091 >2014-01-30 08:14:39,524 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] No up server in cluster >2014-01-30 08:14:39,524 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:14:39,526 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] No up server in cluster >2014-01-30 08:14:39,526 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:14:39,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18829b0c >2014-01-30 08:14:40,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 18829b0c >2014-01-30 08:14:40,048 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] No up server in cluster >2014-01-30 08:14:40,048 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:14:41,295 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:14:42,782 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:14:44,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 55a5b767 >2014-01-30 08:14:44,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 55a5b767 >2014-01-30 08:14:44,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 356ce26a >2014-01-30 08:14:44,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2622451a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ed6c434}, log id: 356ce26a >2014-01-30 08:14:46,315 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-56) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:14:47,799 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-53) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:14:50,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7bcee8db >2014-01-30 08:14:50,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7bcee8db >2014-01-30 08:14:50,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 545d6e78 >2014-01-30 08:14:50,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db8b077f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f581cb21}, log id: 545d6e78 >2014-01-30 08:14:51,333 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:14:52,816 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:14:55,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 527d28b6 >2014-01-30 08:14:56,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 527d28b6 >2014-01-30 08:14:56,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2be527dc >2014-01-30 08:14:56,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7de8236f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c382f955}, log id: 2be527dc >2014-01-30 08:14:56,346 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:14:57,828 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:01,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ae2dcf6 >2014-01-30 08:15:01,359 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:01,814 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: ae2dcf6 >2014-01-30 08:15:01,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 73978b42 >2014-01-30 08:15:02,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d91aebd0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c6cbc5d}, log id: 73978b42 >2014-01-30 08:15:02,841 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:06,378 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:07,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ce1dcc8 >2014-01-30 08:15:07,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6ce1dcc8 >2014-01-30 08:15:07,587 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4311d6a1 >2014-01-30 08:15:07,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6cb534, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93d713da}, log id: 4311d6a1 >2014-01-30 08:15:07,859 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:11,396 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:12,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 569183a7 >2014-01-30 08:15:12,878 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:13,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 569183a7 >2014-01-30 08:15:13,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 286e2447 >2014-01-30 08:15:13,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2319910c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c95d52cf}, log id: 286e2447 >2014-01-30 08:15:16,411 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:17,897 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:18,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f041e97 >2014-01-30 08:15:19,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5f041e97 >2014-01-30 08:15:19,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ee53066 >2014-01-30 08:15:19,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c01da349, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86964265}, log id: 2ee53066 >2014-01-30 08:15:19,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d2a7f1c >2014-01-30 08:15:19,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2d8afe3e, log id: 4d2a7f1c >2014-01-30 08:15:19,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 39afce >2014-01-30 08:15:20,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@933e4ce, log id: 39afce >2014-01-30 08:15:21,428 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:22,917 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:24,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6de02699 >2014-01-30 08:15:24,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6de02699 >2014-01-30 08:15:24,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 431382e3 >2014-01-30 08:15:25,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43003f4b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6452a32}, log id: 431382e3 >2014-01-30 08:15:26,446 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:27,942 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:30,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3cd4310a >2014-01-30 08:15:30,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3cd4310a >2014-01-30 08:15:30,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 789d578c >2014-01-30 08:15:30,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a0b7dc0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ca5fa71}, log id: 789d578c >2014-01-30 08:15:31,467 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:32,961 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:35,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 129e3395 >2014-01-30 08:15:36,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 129e3395 >2014-01-30 08:15:36,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19f63efc >2014-01-30 08:15:36,488 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:36,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96c22b79, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff78b03d}, log id: 19f63efc >2014-01-30 08:15:37,980 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-68) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:40,053 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-62) [1449451c] No up server in cluster >2014-01-30 08:15:40,053 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-62) [1449451c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:15:40,055 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-62) [1449451c] No up server in cluster >2014-01-30 08:15:40,055 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-62) [1449451c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:15:40,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 65b1fcec >2014-01-30 08:15:40,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 65b1fcec >2014-01-30 08:15:40,600 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-62) [1449451c] No up server in cluster >2014-01-30 08:15:40,600 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-62) [1449451c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:15:41,504 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:41,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a034abd >2014-01-30 08:15:42,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1a034abd >2014-01-30 08:15:42,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ccc0cb7 >2014-01-30 08:15:42,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff161053, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35a171a4}, log id: 6ccc0cb7 >2014-01-30 08:15:43,001 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:46,525 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:47,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31daa7d2 >2014-01-30 08:15:47,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 31daa7d2 >2014-01-30 08:15:47,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 615c0191 >2014-01-30 08:15:48,018 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:48,147 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ebe772b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ea63e01}, log id: 615c0191 >2014-01-30 08:15:51,540 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-20) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:53,040 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:53,188 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 209bf8c4 >2014-01-30 08:15:53,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 209bf8c4 >2014-01-30 08:15:53,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6fd9fa80 >2014-01-30 08:15:53,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9faed64, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47e48181}, log id: 6fd9fa80 >2014-01-30 08:15:56,557 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:58,055 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:15:58,856 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4df0f03d >2014-01-30 08:15:59,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4df0f03d >2014-01-30 08:15:59,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 723ea79c >2014-01-30 08:15:59,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@159e66e6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c31d65e}, log id: 723ea79c >2014-01-30 08:16:01,571 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:16:03,068 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:16:04,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66785d4 >2014-01-30 08:16:05,050 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 66785d4 >2014-01-30 08:16:05,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 553db095 >2014-01-30 08:16:05,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66168680, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ceafef4}, log id: 553db095 >2014-01-30 08:16:06,586 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-39) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:16:08,085 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:16:10,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 39e82c76 >2014-01-30 08:16:10,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 39e82c76 >2014-01-30 08:16:10,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c1c0cd9 >2014-01-30 08:16:11,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eddd18e6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ef096fc}, log id: c1c0cd9 >2014-01-30 08:16:11,605 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-45) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:16:13,103 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:16:16,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67ca2de0 >2014-01-30 08:16:16,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 67ca2de0 >2014-01-30 08:16:16,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5cad7f41 >2014-01-30 08:16:16,625 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:16:16,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81fbe356, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@faf2be7}, log id: 5cad7f41 >2014-01-30 08:16:18,119 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:16:21,645 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:16:21,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 596a6c9a >2014-01-30 08:16:22,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 596a6c9a >2014-01-30 08:16:22,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ab5a0c9 >2014-01-30 08:16:22,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b76d919a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@645b2a29}, log id: 5ab5a0c9 >2014-01-30 08:16:23,137 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:16:26,667 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-73) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:16:27,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 470031f8 >2014-01-30 08:16:28,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 470031f8 >2014-01-30 08:16:28,100 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4cfe12e9 >2014-01-30 08:16:28,154 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:16:28,342 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d293062a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb14f47c}, log id: 4cfe12e9 >2014-01-30 08:16:31,681 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:16:33,166 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:16:33,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7902a1 >2014-01-30 08:16:33,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7902a1 >2014-01-30 08:16:33,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46b884e9 >2014-01-30 08:16:34,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1054d87d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f0f2f74}, log id: 46b884e9 >2014-01-30 08:16:36,692 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:16:38,183 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:16:39,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7eaa7c9 >2014-01-30 08:16:39,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7eaa7c9 >2014-01-30 08:16:39,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 57894cc2 >2014-01-30 08:16:39,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9cd764b2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@896e8a62}, log id: 57894cc2 >2014-01-30 08:16:40,607 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) [5049497] No up server in cluster >2014-01-30 08:16:40,607 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) [5049497] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:16:40,610 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) [5049497] No up server in cluster >2014-01-30 08:16:40,610 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) [5049497] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:16:40,615 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 67ecde2b >2014-01-30 08:16:41,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 67ecde2b >2014-01-30 08:16:41,080 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) [5049497] No up server in cluster >2014-01-30 08:16:41,080 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) [5049497] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:16:41,705 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:16:43,200 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:16:44,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e622c0a >2014-01-30 08:16:45,271 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e622c0a >2014-01-30 08:16:45,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58b111d0 >2014-01-30 08:16:45,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8cececa2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8efd61}, log id: 58b111d0 >2014-01-30 08:16:46,727 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:16:48,218 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:16:50,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 797829f3 >2014-01-30 08:16:50,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 797829f3 >2014-01-30 08:16:50,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72457c42 >2014-01-30 08:16:51,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e6a54cc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c91d3265}, log id: 72457c42 >2014-01-30 08:16:51,744 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:16:53,233 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:16:56,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78fb5e77 >2014-01-30 08:16:56,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 78fb5e77 >2014-01-30 08:16:56,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7eb1b553 >2014-01-30 08:16:56,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4cc30534, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d7cc488}, log id: 7eb1b553 >2014-01-30 08:16:56,757 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:16:58,245 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:01,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7bc24aed >2014-01-30 08:17:01,778 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:01,972 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7bc24aed >2014-01-30 08:17:01,977 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b3c1278 >2014-01-30 08:17:02,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee1bfda1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fca9cd4a}, log id: 5b3c1278 >2014-01-30 08:17:03,261 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-68) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:06,793 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:07,214 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e1eaab9 >2014-01-30 08:17:07,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2e1eaab9 >2014-01-30 08:17:07,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59caa720 >2014-01-30 08:17:07,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce727c07, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eaf4dd17}, log id: 59caa720 >2014-01-30 08:17:08,275 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:11,807 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:12,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78ddfe23 >2014-01-30 08:17:13,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 78ddfe23 >2014-01-30 08:17:13,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2237fb77 >2014-01-30 08:17:13,291 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:13,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53ebdf81, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb56c1a}, log id: 2237fb77 >2014-01-30 08:17:16,828 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:18,309 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:18,399 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a46eef2 >2014-01-30 08:17:18,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5a46eef2 >2014-01-30 08:17:18,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41b7f818 >2014-01-30 08:17:19,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0867549, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efca936a}, log id: 41b7f818 >2014-01-30 08:17:21,846 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:23,327 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:24,116 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32fabcbd >2014-01-30 08:17:24,461 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 32fabcbd >2014-01-30 08:17:24,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 536e297 >2014-01-30 08:17:24,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f869d50, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c34516f9}, log id: 536e297 >2014-01-30 08:17:26,865 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:28,345 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:29,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b35b118 >2014-01-30 08:17:30,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1b35b118 >2014-01-30 08:17:30,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5282d26f >2014-01-30 08:17:30,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7c5f5f6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@101814b9}, log id: 5282d26f >2014-01-30 08:17:31,883 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-56) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:33,361 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:35,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5612083 >2014-01-30 08:17:35,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5612083 >2014-01-30 08:17:35,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65c2026f >2014-01-30 08:17:36,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f64ac3d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfc56d3e}, log id: 65c2026f >2014-01-30 08:17:36,900 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:38,380 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-4) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:41,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7343dc6f >2014-01-30 08:17:41,088 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-10) [641a6d1] No up server in cluster >2014-01-30 08:17:41,088 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-10) [641a6d1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:17:41,091 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-10) [641a6d1] No up server in cluster >2014-01-30 08:17:41,091 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-10) [641a6d1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:17:41,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 5b1f4da1 >2014-01-30 08:17:41,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7343dc6f >2014-01-30 08:17:41,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b377a53 >2014-01-30 08:17:41,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 5b1f4da1 >2014-01-30 08:17:41,616 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-10) [641a6d1] No up server in cluster >2014-01-30 08:17:41,616 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-10) [641a6d1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:17:41,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fe8a00b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91ecfd33}, log id: 7b377a53 >2014-01-30 08:17:41,924 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:43,399 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:46,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f8d42fd >2014-01-30 08:17:46,944 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:47,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1f8d42fd >2014-01-30 08:17:47,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 122790f1 >2014-01-30 08:17:47,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13649333, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4990701}, log id: 122790f1 >2014-01-30 08:17:48,419 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:51,961 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:52,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13b1800 >2014-01-30 08:17:53,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 13b1800 >2014-01-30 08:17:53,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b2d87f9 >2014-01-30 08:17:53,440 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:53,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfb905c9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d6bdcee}, log id: 3b2d87f9 >2014-01-30 08:17:56,980 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-20) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:58,463 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:17:58,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b0948a7 >2014-01-30 08:17:59,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7b0948a7 >2014-01-30 08:17:59,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21b96048 >2014-01-30 08:17:59,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8e5ed0f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8aaa3ed8}, log id: 21b96048 >2014-01-30 08:18:02,006 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:18:03,486 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:18:04,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68a6febb >2014-01-30 08:18:04,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 68a6febb >2014-01-30 08:18:04,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b3904d9 >2014-01-30 08:18:05,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14ac0c1c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3297c8d}, log id: b3904d9 >2014-01-30 08:18:07,023 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:18:08,504 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:18:10,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 767c551c >2014-01-30 08:18:10,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 767c551c >2014-01-30 08:18:10,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1104683c >2014-01-30 08:18:10,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30c81185, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba036c84}, log id: 1104683c >2014-01-30 08:18:12,041 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:18:13,521 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:18:15,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e441cf9 >2014-01-30 08:18:16,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6e441cf9 >2014-01-30 08:18:16,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3527be0a >2014-01-30 08:18:16,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d159eed, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a175e72}, log id: 3527be0a >2014-01-30 08:18:17,054 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:18:18,533 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:18:21,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31f10cbb >2014-01-30 08:18:21,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 31f10cbb >2014-01-30 08:18:21,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 578fe75c >2014-01-30 08:18:22,069 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:18:22,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a9a34c7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aea70ea5}, log id: 578fe75c >2014-01-30 08:18:23,553 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:18:27,089 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:18:27,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c8b8031 >2014-01-30 08:18:27,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: c8b8031 >2014-01-30 08:18:27,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 741d3686 >2014-01-30 08:18:27,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec642079, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3852c9c0}, log id: 741d3686 >2014-01-30 08:18:28,571 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:18:32,145 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:18:32,934 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77c7402e >2014-01-30 08:18:33,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 77c7402e >2014-01-30 08:18:33,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2387ea7d >2014-01-30 08:18:33,589 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:18:33,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19fb964c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78be105f}, log id: 2387ea7d >2014-01-30 08:18:37,161 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:18:38,606 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:18:38,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f055730 >2014-01-30 08:18:39,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: f055730 >2014-01-30 08:18:39,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f8d16bc >2014-01-30 08:18:39,463 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@285f397b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66cc9df9}, log id: 1f8d16bc >2014-01-30 08:18:41,622 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] No up server in cluster >2014-01-30 08:18:41,622 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:18:41,625 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] No up server in cluster >2014-01-30 08:18:41,625 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:18:41,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30e7f4dd >2014-01-30 08:18:42,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 30e7f4dd >2014-01-30 08:18:42,178 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:18:42,187 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] No up server in cluster >2014-01-30 08:18:42,187 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:18:43,627 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:18:44,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5379f0aa >2014-01-30 08:18:45,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5379f0aa >2014-01-30 08:18:45,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27cbbad >2014-01-30 08:18:45,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c49db5bc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed0ccfb3}, log id: 27cbbad >2014-01-30 08:18:47,198 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:18:48,647 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:18:50,340 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65d360ff >2014-01-30 08:18:50,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 65d360ff >2014-01-30 08:18:50,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46999501 >2014-01-30 08:18:51,106 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae6c7ef7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46532cb8}, log id: 46999501 >2014-01-30 08:18:52,218 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:18:53,668 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:18:56,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17028f67 >2014-01-30 08:18:56,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 17028f67 >2014-01-30 08:18:56,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1bc36e46 >2014-01-30 08:18:56,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4adb3729, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f37a876}, log id: 1bc36e46 >2014-01-30 08:18:57,242 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:18:58,688 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:02,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4dffe222 >2014-01-30 08:19:02,262 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:02,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4dffe222 >2014-01-30 08:19:02,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 70649322 >2014-01-30 08:19:02,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac1abc11, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b53ac140}, log id: 70649322 >2014-01-30 08:19:03,708 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:07,284 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:07,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 108c84bc >2014-01-30 08:19:08,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 108c84bc >2014-01-30 08:19:08,237 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ecd49d0 >2014-01-30 08:19:08,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9832f06c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@44b2633d}, log id: 4ecd49d0 >2014-01-30 08:19:08,728 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:12,306 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:13,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12ff5c8 >2014-01-30 08:19:13,748 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:14,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 12ff5c8 >2014-01-30 08:19:14,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20e5ea91 >2014-01-30 08:19:14,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2c58235, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f956dcaf}, log id: 20e5ea91 >2014-01-30 08:19:17,326 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:18,766 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:19,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76078b80 >2014-01-30 08:19:19,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 76078b80 >2014-01-30 08:19:19,849 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f155e93 >2014-01-30 08:19:20,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95c00045, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a0aeddeb}, log id: 4f155e93 >2014-01-30 08:19:22,343 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:23,786 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:25,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2142322b >2014-01-30 08:19:25,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2142322b >2014-01-30 08:19:25,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 353fad2c >2014-01-30 08:19:25,901 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9212dc6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8de58e16}, log id: 353fad2c >2014-01-30 08:19:27,364 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:28,808 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:30,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 577c60f0 >2014-01-30 08:19:31,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 577c60f0 >2014-01-30 08:19:31,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ad9d049 >2014-01-30 08:19:31,629 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5302732b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20cccd9d}, log id: 1ad9d049 >2014-01-30 08:19:32,383 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:33,830 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:36,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10408ec4 >2014-01-30 08:19:37,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 10408ec4 >2014-01-30 08:19:37,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a5e691a >2014-01-30 08:19:37,404 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:37,448 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9692426, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a91b7a33}, log id: 5a5e691a >2014-01-30 08:19:38,848 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:42,193 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2014-01-30 08:19:42,194 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:19:42,197 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2014-01-30 08:19:42,197 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:19:42,203 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3512d33 >2014-01-30 08:19:42,421 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:42,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e647411 >2014-01-30 08:19:42,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 3512d33 >2014-01-30 08:19:42,761 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-4) No up server in cluster >2014-01-30 08:19:42,762 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-4) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:19:42,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7e647411 >2014-01-30 08:19:43,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 273f8e87 >2014-01-30 08:19:43,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af431d03, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c527f38}, log id: 273f8e87 >2014-01-30 08:19:43,869 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:47,439 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:48,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8efe9c5 >2014-01-30 08:19:48,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 8efe9c5 >2014-01-30 08:19:48,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 61c763f5 >2014-01-30 08:19:48,891 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:49,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f4d10eae, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@599ac1d9}, log id: 61c763f5 >2014-01-30 08:19:52,458 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:53,913 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-73) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:54,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6630cef7 >2014-01-30 08:19:54,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6630cef7 >2014-01-30 08:19:54,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ef5d29b >2014-01-30 08:19:54,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2b2f6fc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3564c02f}, log id: 6ef5d29b >2014-01-30 08:19:57,480 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:58,933 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:19:59,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69c081ef >2014-01-30 08:20:00,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 69c081ef >2014-01-30 08:20:00,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1dd46eb0 >2014-01-30 08:20:00,741 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c288d8e6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3abe0ae}, log id: 1dd46eb0 >2014-01-30 08:20:02,501 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:20:03,956 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:20:05,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b5a4a39 >2014-01-30 08:20:06,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b5a4a39 >2014-01-30 08:20:06,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42fcf766 >2014-01-30 08:20:06,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@160ea0b6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@19780e1a}, log id: 42fcf766 >2014-01-30 08:20:07,524 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:20:08,976 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:20:11,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53ceff1d >2014-01-30 08:20:12,124 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 53ceff1d >2014-01-30 08:20:12,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e6d6359 >2014-01-30 08:20:12,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec16a078, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@265777bb}, log id: 3e6d6359 >2014-01-30 08:20:12,544 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:20:13,995 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:20:17,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4fa38b23 >2014-01-30 08:20:17,565 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:20:17,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4fa38b23 >2014-01-30 08:20:17,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c5d6962 >2014-01-30 08:20:18,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b487ff5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@92b4db2}, log id: c5d6962 >2014-01-30 08:20:19,017 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:20:20,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 5f60c3d2 >2014-01-30 08:20:20,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2c220b85, log id: 5f60c3d2 >2014-01-30 08:20:20,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 6f225f65 >2014-01-30 08:20:20,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@27b6f517, log id: 6f225f65 >2014-01-30 08:20:22,587 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:20:23,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4eeb3a78 >2014-01-30 08:20:23,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4eeb3a78 >2014-01-30 08:20:23,800 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74d9de8a >2014-01-30 08:20:24,040 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:20:24,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9d1c4c2a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ae4439a0}, log id: 74d9de8a >2014-01-30 08:20:27,615 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:20:29,056 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:20:29,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5276c10b >2014-01-30 08:20:29,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5276c10b >2014-01-30 08:20:29,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79df2a35 >2014-01-30 08:20:29,868 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad22adf1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5098188b}, log id: 79df2a35 >2014-01-30 08:20:32,636 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:20:34,077 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:20:34,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4578c4df >2014-01-30 08:20:35,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4578c4df >2014-01-30 08:20:35,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f2a1b51 >2014-01-30 08:20:35,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6006de2e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e2e0b84}, log id: 5f2a1b51 >2014-01-30 08:20:37,654 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:20:39,097 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-69) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:20:40,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a99b724 >2014-01-30 08:20:41,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7a99b724 >2014-01-30 08:20:41,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5bbf8bfa >2014-01-30 08:20:41,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2716be48, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6cf9f42}, log id: 5bbf8bfa >2014-01-30 08:20:42,675 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:20:42,771 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-12) [690883a1] No up server in cluster >2014-01-30 08:20:42,771 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-12) [690883a1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:20:42,774 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-12) [690883a1] No up server in cluster >2014-01-30 08:20:42,775 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-12) [690883a1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:20:42,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 175376e7 >2014-01-30 08:20:43,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 175376e7 >2014-01-30 08:20:43,332 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-12) [690883a1] No up server in cluster >2014-01-30 08:20:43,332 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-12) [690883a1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:20:44,119 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:20:46,539 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 115a07dc >2014-01-30 08:20:47,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 115a07dc >2014-01-30 08:20:47,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 100563d0 >2014-01-30 08:20:47,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f1db2bd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@755c4a26}, log id: 100563d0 >2014-01-30 08:20:47,696 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:20:49,138 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:20:52,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18fb456d >2014-01-30 08:20:52,715 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:20:52,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 18fb456d >2014-01-30 08:20:52,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c035eec >2014-01-30 08:20:53,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3146c076, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af85c3b8}, log id: c035eec >2014-01-30 08:20:54,160 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:20:57,735 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-56) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:20:58,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c73531c >2014-01-30 08:20:58,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: c73531c >2014-01-30 08:20:58,680 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 277947cf >2014-01-30 08:20:58,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@400591dc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@34c3b523}, log id: 277947cf >2014-01-30 08:20:59,181 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:02,755 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:04,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 614f75a4 >2014-01-30 08:21:04,201 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:04,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 614f75a4 >2014-01-30 08:21:04,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b56f7b5 >2014-01-30 08:21:04,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c15526e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9f45e6}, log id: 3b56f7b5 >2014-01-30 08:21:07,774 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:09,217 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:09,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f6805d3 >2014-01-30 08:21:10,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2f6805d3 >2014-01-30 08:21:10,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6bcfebd4 >2014-01-30 08:21:10,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@613be239, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@738a9082}, log id: 6bcfebd4 >2014-01-30 08:21:12,794 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:14,237 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:15,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e0c2af3 >2014-01-30 08:21:16,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3e0c2af3 >2014-01-30 08:21:16,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ad25616 >2014-01-30 08:21:16,384 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c477c6fa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@deb0bcd4}, log id: 7ad25616 >2014-01-30 08:21:17,812 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:19,292 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:21,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b2e475a >2014-01-30 08:21:21,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4b2e475a >2014-01-30 08:21:21,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f7449d0 >2014-01-30 08:21:22,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6da238e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e648a2af}, log id: 2f7449d0 >2014-01-30 08:21:22,834 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:24,313 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-20) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:27,227 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35b50277 >2014-01-30 08:21:27,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 35b50277 >2014-01-30 08:21:27,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76766697 >2014-01-30 08:21:27,855 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:27,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfae27ba, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79d2bb65}, log id: 76766697 >2014-01-30 08:21:29,345 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:32,875 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:33,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1dec4bbd >2014-01-30 08:21:33,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1dec4bbd >2014-01-30 08:21:33,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11930e92 >2014-01-30 08:21:33,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a97ec44e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4c3906f}, log id: 11930e92 >2014-01-30 08:21:34,367 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:37,895 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:38,827 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13e0f0ad >2014-01-30 08:21:39,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 13e0f0ad >2014-01-30 08:21:39,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5abec71a >2014-01-30 08:21:39,388 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-53) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:39,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e77cb6bc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2f1e1f5}, log id: 5abec71a >2014-01-30 08:21:42,914 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:43,338 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2014-01-30 08:21:43,338 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:21:43,341 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2014-01-30 08:21:43,341 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:21:43,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 4c38b8ed >2014-01-30 08:21:43,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 4c38b8ed >2014-01-30 08:21:43,912 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2014-01-30 08:21:43,912 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:21:44,405 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:44,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 978ae66 >2014-01-30 08:21:45,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 978ae66 >2014-01-30 08:21:45,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ca2a2f1 >2014-01-30 08:21:45,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc121cd9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4615ef7}, log id: 6ca2a2f1 >2014-01-30 08:21:47,933 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:49,423 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:50,468 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59f395d8 >2014-01-30 08:21:50,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 59f395d8 >2014-01-30 08:21:50,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79209cb3 >2014-01-30 08:21:51,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7af2033, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39e08c0}, log id: 79209cb3 >2014-01-30 08:21:52,955 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:54,442 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:56,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e115932 >2014-01-30 08:21:56,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7e115932 >2014-01-30 08:21:56,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76caadc8 >2014-01-30 08:21:57,038 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f59684cd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c3452bdb}, log id: 76caadc8 >2014-01-30 08:21:57,975 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:21:59,464 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:02,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22381ea3 >2014-01-30 08:22:02,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 22381ea3 >2014-01-30 08:22:02,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14016628 >2014-01-30 08:22:02,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfa2c248, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eace5da}, log id: 14016628 >2014-01-30 08:22:02,995 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:04,483 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:07,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79136709 >2014-01-30 08:22:08,016 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:08,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 79136709 >2014-01-30 08:22:08,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 269d5797 >2014-01-30 08:22:08,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@49ff12b6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee52d579}, log id: 269d5797 >2014-01-30 08:22:09,504 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:13,031 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:13,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 696d8329 >2014-01-30 08:22:14,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 696d8329 >2014-01-30 08:22:14,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 724495a1 >2014-01-30 08:22:14,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e53e8959, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76c89ba2}, log id: 724495a1 >2014-01-30 08:22:14,524 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:18,051 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-39) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:19,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1acfb437 >2014-01-30 08:22:19,544 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:19,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1acfb437 >2014-01-30 08:22:19,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7768ff85 >2014-01-30 08:22:20,252 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6feb660e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f8f01bb5}, log id: 7768ff85 >2014-01-30 08:22:23,073 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:24,562 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:25,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b1dc636 >2014-01-30 08:22:25,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2b1dc636 >2014-01-30 08:22:25,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4cec4908 >2014-01-30 08:22:26,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6681d91d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7b5bcee}, log id: 4cec4908 >2014-01-30 08:22:28,094 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:29,581 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:31,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69d4c0a4 >2014-01-30 08:22:31,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 69d4c0a4 >2014-01-30 08:22:31,632 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f88366b >2014-01-30 08:22:31,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f64fd540, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21a530e2}, log id: f88366b >2014-01-30 08:22:33,118 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:34,600 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:36,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7abc3a67 >2014-01-30 08:22:37,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7abc3a67 >2014-01-30 08:22:37,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32d73d31 >2014-01-30 08:22:37,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9340633b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8941c9b1}, log id: 32d73d31 >2014-01-30 08:22:38,139 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:39,620 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:42,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 504acb10 >2014-01-30 08:22:43,160 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:43,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 504acb10 >2014-01-30 08:22:43,315 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25bf89e >2014-01-30 08:22:43,588 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b69d81d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a0dca42}, log id: 25bf89e >2014-01-30 08:22:43,919 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] No up server in cluster >2014-01-30 08:22:43,920 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:22:43,923 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] No up server in cluster >2014-01-30 08:22:43,923 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:22:43,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10686348 >2014-01-30 08:22:44,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 10686348 >2014-01-30 08:22:44,481 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] No up server in cluster >2014-01-30 08:22:44,481 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:22:44,643 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-69) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:48,180 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:48,639 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67bcef7e >2014-01-30 08:22:49,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 67bcef7e >2014-01-30 08:22:49,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: be4ad9e >2014-01-30 08:22:49,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24172a8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4be649da}, log id: be4ad9e >2014-01-30 08:22:49,666 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:53,202 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:54,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66c7ee6f >2014-01-30 08:22:54,686 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:54,937 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 66c7ee6f >2014-01-30 08:22:54,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b153561 >2014-01-30 08:22:55,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1b0b4b7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4c2726f}, log id: 1b153561 >2014-01-30 08:22:58,223 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:22:59,705 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:00,248 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fc86afd >2014-01-30 08:23:00,738 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3fc86afd >2014-01-30 08:23:00,745 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44f431b2 >2014-01-30 08:23:01,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a33cb5be, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1fa8dede}, log id: 44f431b2 >2014-01-30 08:23:03,243 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-56) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:04,725 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:06,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56391978 >2014-01-30 08:23:06,554 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 56391978 >2014-01-30 08:23:06,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51265457 >2014-01-30 08:23:06,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d58a876, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43c160a6}, log id: 51265457 >2014-01-30 08:23:08,266 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-4) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:09,746 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:11,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46abf68c >2014-01-30 08:23:12,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 46abf68c >2014-01-30 08:23:12,359 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4334c5cf >2014-01-30 08:23:12,621 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@168c9bbf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5da0b66d}, log id: 4334c5cf >2014-01-30 08:23:13,285 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:14,765 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:17,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 366a5c8e >2014-01-30 08:23:18,152 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 366a5c8e >2014-01-30 08:23:18,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 729376d7 >2014-01-30 08:23:18,306 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:18,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f231de73, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e8540e93}, log id: 729376d7 >2014-01-30 08:23:19,785 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-73) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:23,327 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:23,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46194212 >2014-01-30 08:23:23,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 46194212 >2014-01-30 08:23:23,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 716ac758 >2014-01-30 08:23:24,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c22aa011, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4202aa64}, log id: 716ac758 >2014-01-30 08:23:24,806 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:28,349 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:29,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f1c46ae >2014-01-30 08:23:29,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: f1c46ae >2014-01-30 08:23:29,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a19a4fb >2014-01-30 08:23:29,829 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-20) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:30,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b7b87a7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9aafae0}, log id: 4a19a4fb >2014-01-30 08:23:33,370 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:34,850 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:35,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6aa98bf2 >2014-01-30 08:23:35,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6aa98bf2 >2014-01-30 08:23:35,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2bff5621 >2014-01-30 08:23:35,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@205ba1ee, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c463d5e}, log id: 2bff5621 >2014-01-30 08:23:38,386 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:39,872 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-39) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:40,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e1da2b7 >2014-01-30 08:23:41,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7e1da2b7 >2014-01-30 08:23:41,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c995065 >2014-01-30 08:23:41,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4cc2f011, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8c3eb28}, log id: 5c995065 >2014-01-30 08:23:43,406 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:44,489 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-74) [61851da7] No up server in cluster >2014-01-30 08:23:44,490 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-74) [61851da7] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:23:44,492 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-74) [61851da7] No up server in cluster >2014-01-30 08:23:44,493 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-74) [61851da7] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:23:44,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 6c50c02b >2014-01-30 08:23:44,892 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:45,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 6c50c02b >2014-01-30 08:23:45,040 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-74) [61851da7] No up server in cluster >2014-01-30 08:23:45,040 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-74) [61851da7] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:23:46,728 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5346d5b0 >2014-01-30 08:23:47,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5346d5b0 >2014-01-30 08:23:47,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 771c01a7 >2014-01-30 08:23:47,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14b1d66, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aefcaed6}, log id: 771c01a7 >2014-01-30 08:23:48,426 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:49,909 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:52,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ec5678b >2014-01-30 08:23:53,036 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7ec5678b >2014-01-30 08:23:53,042 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 169c6be9 >2014-01-30 08:23:53,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73b5c6e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab77cdfe}, log id: 169c6be9 >2014-01-30 08:23:53,447 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:54,926 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:58,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f540423 >2014-01-30 08:23:58,466 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:23:58,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f540423 >2014-01-30 08:23:58,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ba93cf1 >2014-01-30 08:23:59,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b740d2e8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf9e1cc0}, log id: 2ba93cf1 >2014-01-30 08:23:59,948 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:24:03,490 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:24:04,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16b30694 >2014-01-30 08:24:04,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 16b30694 >2014-01-30 08:24:04,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 150f17d3 >2014-01-30 08:24:04,970 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:24:04,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cc5b97b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa183b9d}, log id: 150f17d3 >2014-01-30 08:24:08,510 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:24:09,990 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:24:10,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a061617 >2014-01-30 08:24:10,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6a061617 >2014-01-30 08:24:10,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24033c7a >2014-01-30 08:24:10,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fc5772b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adcc57cc}, log id: 24033c7a >2014-01-30 08:24:13,529 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:24:15,011 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:24:15,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f47bdd4 >2014-01-30 08:24:16,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7f47bdd4 >2014-01-30 08:24:16,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78ddcf06 >2014-01-30 08:24:16,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@639abb86, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0e61f62}, log id: 78ddcf06 >2014-01-30 08:24:18,549 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:24:20,031 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:24:21,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a9fecb8 >2014-01-30 08:24:22,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2a9fecb8 >2014-01-30 08:24:22,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c223b79 >2014-01-30 08:24:22,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1de5cce2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@129fa506}, log id: 7c223b79 >2014-01-30 08:24:23,565 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:24:25,052 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:24:27,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 707541d >2014-01-30 08:24:27,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 707541d >2014-01-30 08:24:28,000 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c0ca9d7 >2014-01-30 08:24:28,277 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@489b2016, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fd77d80}, log id: 7c0ca9d7 >2014-01-30 08:24:28,582 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:24:30,073 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:24:33,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c926952 >2014-01-30 08:24:33,604 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:24:33,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7c926952 >2014-01-30 08:24:33,791 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c27fe47 >2014-01-30 08:24:34,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c816d37, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eec3f2ed}, log id: 4c27fe47 >2014-01-30 08:24:35,094 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:24:38,620 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:24:39,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f9afc56 >2014-01-30 08:24:39,596 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: f9afc56 >2014-01-30 08:24:39,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8991283 >2014-01-30 08:24:39,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3069b68d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@239440b9}, log id: 8991283 >2014-01-30 08:24:40,115 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:24:43,640 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:24:44,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 212c9124 >2014-01-30 08:24:45,047 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) [b80ce35] No up server in cluster >2014-01-30 08:24:45,047 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) [b80ce35] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:24:45,049 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) [b80ce35] No up server in cluster >2014-01-30 08:24:45,049 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) [b80ce35] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:24:45,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5689373b >2014-01-30 08:24:45,135 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-73) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:24:45,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 212c9124 >2014-01-30 08:24:45,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d922b1b >2014-01-30 08:24:45,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 5689373b >2014-01-30 08:24:45,533 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-17) [b80ce35] No up server in cluster >2014-01-30 08:24:45,533 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-17) [b80ce35] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:24:45,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd5e5a1a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fa286aa}, log id: 5d922b1b >2014-01-30 08:24:48,662 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:24:50,153 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:24:50,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: feb900 >2014-01-30 08:24:51,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: feb900 >2014-01-30 08:24:51,170 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f3ef74f >2014-01-30 08:24:51,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf81715d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b21ac19}, log id: 2f3ef74f >2014-01-30 08:24:53,681 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:24:55,173 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:24:56,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16d22f47 >2014-01-30 08:24:56,983 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 16d22f47 >2014-01-30 08:24:56,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d8bd285 >2014-01-30 08:24:57,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ca7ed13, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5414a15a}, log id: 4d8bd285 >2014-01-30 08:24:58,699 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:00,193 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:02,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3cfbe2b0 >2014-01-30 08:25:02,796 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3cfbe2b0 >2014-01-30 08:25:02,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79758128 >2014-01-30 08:25:03,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@995cbbbf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b57d0fc}, log id: 79758128 >2014-01-30 08:25:03,722 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:05,212 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-45) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:08,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7959c92 >2014-01-30 08:25:08,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7959c92 >2014-01-30 08:25:08,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67c87660 >2014-01-30 08:25:08,741 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:08,873 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea4838c1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@172fe618}, log id: 67c87660 >2014-01-30 08:25:10,233 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:13,758 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:13,921 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27b0efb1 >2014-01-30 08:25:14,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 27b0efb1 >2014-01-30 08:25:14,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78c31c5f >2014-01-30 08:25:14,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@987b8305, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc454f96}, log id: 78c31c5f >2014-01-30 08:25:15,252 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:18,779 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:19,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2775da75 >2014-01-30 08:25:20,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2775da75 >2014-01-30 08:25:20,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5734b604 >2014-01-30 08:25:20,271 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:20,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48442db9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc24e04e}, log id: 5734b604 >2014-01-30 08:25:20,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32ff490c >2014-01-30 08:25:21,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2e1ee14f, log id: 32ff490c >2014-01-30 08:25:21,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d5a2130 >2014-01-30 08:25:21,327 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1528dee6, log id: 6d5a2130 >2014-01-30 08:25:23,797 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:25,293 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:25,589 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36e48c16 >2014-01-30 08:25:26,067 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 36e48c16 >2014-01-30 08:25:26,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 602d372a >2014-01-30 08:25:26,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e10d6f2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3bb4278}, log id: 602d372a >2014-01-30 08:25:28,817 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:30,313 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:31,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 62a6c255 >2014-01-30 08:25:31,857 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 62a6c255 >2014-01-30 08:25:31,862 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 55276d87 >2014-01-30 08:25:32,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@624c6d0e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8fd1066b}, log id: 55276d87 >2014-01-30 08:25:33,835 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:35,335 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-20) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:37,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37a7c124 >2014-01-30 08:25:37,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 37a7c124 >2014-01-30 08:25:37,688 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d5456c9 >2014-01-30 08:25:37,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f619743c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ead22503}, log id: 2d5456c9 >2014-01-30 08:25:38,856 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-50) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:40,355 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:42,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21d17d4a >2014-01-30 08:25:43,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 21d17d4a >2014-01-30 08:25:43,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 102e452e >2014-01-30 08:25:43,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79523ac0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f68f6b82}, log id: 102e452e >2014-01-30 08:25:43,875 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:45,374 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-39) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:45,539 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-16) [2c713cf8] No up server in cluster >2014-01-30 08:25:45,540 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-16) [2c713cf8] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:25:45,541 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-16) [2c713cf8] No up server in cluster >2014-01-30 08:25:45,542 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-16) [2c713cf8] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:25:45,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 6784ec20 >2014-01-30 08:25:46,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 6784ec20 >2014-01-30 08:25:46,093 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-16) [2c713cf8] No up server in cluster >2014-01-30 08:25:46,093 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-16) [2c713cf8] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:25:48,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 580e19ed >2014-01-30 08:25:48,896 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-45) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:49,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 580e19ed >2014-01-30 08:25:49,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ba70d06 >2014-01-30 08:25:49,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@675d4a5c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@daae4e2a}, log id: 2ba70d06 >2014-01-30 08:25:50,394 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:53,913 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-4) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:54,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 567a92cf >2014-01-30 08:25:55,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 567a92cf >2014-01-30 08:25:55,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1cce95c4 >2014-01-30 08:25:55,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13681119, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a711a8ac}, log id: 1cce95c4 >2014-01-30 08:25:55,416 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:25:58,934 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:00,435 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:00,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49a08bf3 >2014-01-30 08:26:00,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 49a08bf3 >2014-01-30 08:26:00,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1cafc1a9 >2014-01-30 08:26:01,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12e0615b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fac4a528}, log id: 1cafc1a9 >2014-01-30 08:26:03,954 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:05,454 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:06,267 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35c1524f >2014-01-30 08:26:06,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 35c1524f >2014-01-30 08:26:06,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64ab44ed >2014-01-30 08:26:07,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fd9e0cc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@351ede0a}, log id: 64ab44ed >2014-01-30 08:26:08,974 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:10,475 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:12,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5cc4c6b1 >2014-01-30 08:26:12,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5cc4c6b1 >2014-01-30 08:26:12,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2123dd4e >2014-01-30 08:26:12,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5106de7b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2062d7a7}, log id: 2123dd4e >2014-01-30 08:26:13,993 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:15,494 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:17,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a015951 >2014-01-30 08:26:18,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4a015951 >2014-01-30 08:26:18,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13e899bb >2014-01-30 08:26:18,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@662ae4b7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@20a45f07}, log id: 13e899bb >2014-01-30 08:26:19,015 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-20) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:20,515 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:23,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a918d2f >2014-01-30 08:26:24,031 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:24,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a918d2f >2014-01-30 08:26:24,157 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38ba7970 >2014-01-30 08:26:24,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8538877f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e83315e5}, log id: 38ba7970 >2014-01-30 08:26:25,535 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:29,057 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:29,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2663ed87 >2014-01-30 08:26:29,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2663ed87 >2014-01-30 08:26:29,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76a6e6d4 >2014-01-30 08:26:30,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6ba59de, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5896c5e2}, log id: 76a6e6d4 >2014-01-30 08:26:30,557 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:34,077 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:35,279 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 491c04e >2014-01-30 08:26:35,577 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:35,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 491c04e >2014-01-30 08:26:35,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10c5a924 >2014-01-30 08:26:36,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d1f369d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23dc52fb}, log id: 10c5a924 >2014-01-30 08:26:39,099 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:40,596 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:41,086 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5022defc >2014-01-30 08:26:41,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5022defc >2014-01-30 08:26:41,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65d2b710 >2014-01-30 08:26:41,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d19b072d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8876278}, log id: 65d2b710 >2014-01-30 08:26:44,119 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:45,616 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:46,101 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-15) [13272f75] No up server in cluster >2014-01-30 08:26:46,101 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-15) [13272f75] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:26:46,104 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-15) [13272f75] No up server in cluster >2014-01-30 08:26:46,104 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-15) [13272f75] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:26:46,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 1eb1c05 >2014-01-30 08:26:46,625 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 1eb1c05 >2014-01-30 08:26:46,643 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-15) [13272f75] No up server in cluster >2014-01-30 08:26:46,643 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-15) [13272f75] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:26:46,905 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4bdad89a >2014-01-30 08:26:47,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4bdad89a >2014-01-30 08:26:47,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e9d8e3f >2014-01-30 08:26:47,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@432f4dce, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e8cec44}, log id: 1e9d8e3f >2014-01-30 08:26:49,141 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:50,638 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:52,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4bc929fe >2014-01-30 08:26:53,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4bc929fe >2014-01-30 08:26:53,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f5b0454 >2014-01-30 08:26:53,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cfb2966, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f32107f5}, log id: 7f5b0454 >2014-01-30 08:26:54,163 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:55,657 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:58,576 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a173ba0 >2014-01-30 08:26:59,048 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3a173ba0 >2014-01-30 08:26:59,054 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1de17eeb >2014-01-30 08:26:59,183 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:26:59,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b4988, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba33ac44}, log id: 1de17eeb >2014-01-30 08:27:00,677 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:27:04,201 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-50) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:27:04,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4308002a >2014-01-30 08:27:04,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4308002a >2014-01-30 08:27:04,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: bb1809e >2014-01-30 08:27:05,130 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aba43923, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b02258d5}, log id: bb1809e >2014-01-30 08:27:05,699 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:27:09,222 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:27:10,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27607032 >2014-01-30 08:27:10,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 27607032 >2014-01-30 08:27:10,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51dc2360 >2014-01-30 08:27:10,720 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:27:10,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b72b1d0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4cba792}, log id: 51dc2360 >2014-01-30 08:27:14,240 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:27:15,737 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:27:15,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30b9c14 >2014-01-30 08:27:16,498 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 30b9c14 >2014-01-30 08:27:16,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 196a1617 >2014-01-30 08:27:16,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@913eb6a0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b9241ad4}, log id: 196a1617 >2014-01-30 08:27:19,262 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-4) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:27:20,759 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:27:21,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e511f09 >2014-01-30 08:27:22,319 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6e511f09 >2014-01-30 08:27:22,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50e616f0 >2014-01-30 08:27:22,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7091c4ea, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7faa2726}, log id: 50e616f0 >2014-01-30 08:27:24,282 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:27:25,780 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:27:27,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b1a188e >2014-01-30 08:27:28,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3b1a188e >2014-01-30 08:27:28,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7287bb8d >2014-01-30 08:27:28,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a133076d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@76b3a82d}, log id: 7287bb8d >2014-01-30 08:27:29,305 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:27:30,801 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:27:33,446 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d77924b >2014-01-30 08:27:33,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6d77924b >2014-01-30 08:27:33,929 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23195056 >2014-01-30 08:27:34,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14f8e155, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97147e99}, log id: 23195056 >2014-01-30 08:27:34,326 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:27:35,821 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:27:39,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a75f4b4 >2014-01-30 08:27:39,347 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:27:39,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2a75f4b4 >2014-01-30 08:27:39,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: de698 >2014-01-30 08:27:40,044 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1a0a01b1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d16ce51a}, log id: de698 >2014-01-30 08:27:40,842 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:27:44,369 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-20) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:27:45,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 140928db >2014-01-30 08:27:45,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 140928db >2014-01-30 08:27:45,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b9c5253 >2014-01-30 08:27:45,862 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:27:45,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a08c5b7c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a6f9bf7}, log id: 6b9c5253 >2014-01-30 08:27:46,651 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-81) [5c437990] No up server in cluster >2014-01-30 08:27:46,651 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-81) [5c437990] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:27:46,654 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-81) [5c437990] No up server in cluster >2014-01-30 08:27:46,655 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-81) [5c437990] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:27:46,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5899a6bc >2014-01-30 08:27:47,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 5899a6bc >2014-01-30 08:27:47,211 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-81) [5c437990] No up server in cluster >2014-01-30 08:27:47,211 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-81) [5c437990] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:27:49,390 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:27:50,882 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:27:50,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 94cf25a >2014-01-30 08:27:51,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 94cf25a >2014-01-30 08:27:51,422 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4167bd11 >2014-01-30 08:27:51,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d4f8cc0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@96f7a1de}, log id: 4167bd11 >2014-01-30 08:27:54,411 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:27:55,904 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:27:56,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 364b7fb0 >2014-01-30 08:27:57,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 364b7fb0 >2014-01-30 08:27:57,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3411cb03 >2014-01-30 08:27:57,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b192faf5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0bf5d0e}, log id: 3411cb03 >2014-01-30 08:27:59,431 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-68) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:00,925 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:02,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 498ef938 >2014-01-30 08:28:03,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 498ef938 >2014-01-30 08:28:03,083 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f00ebba >2014-01-30 08:28:03,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99afb583, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce01a524}, log id: 7f00ebba >2014-01-30 08:28:04,451 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:05,941 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:08,407 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f488292 >2014-01-30 08:28:08,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1f488292 >2014-01-30 08:28:08,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 218aa402 >2014-01-30 08:28:09,169 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72fd0cc9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1dd5aef}, log id: 218aa402 >2014-01-30 08:28:09,472 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:10,960 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:14,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6078425a >2014-01-30 08:28:14,492 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:14,693 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6078425a >2014-01-30 08:28:14,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f9d092d >2014-01-30 08:28:14,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f9966314, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb9ffc34}, log id: 2f9d092d >2014-01-30 08:28:15,980 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:19,508 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:20,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77d31801 >2014-01-30 08:28:20,517 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 77d31801 >2014-01-30 08:28:20,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50f979ab >2014-01-30 08:28:20,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c6e48267, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf8aa8c1}, log id: 50f979ab >2014-01-30 08:28:21,001 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:24,529 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:25,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77157869 >2014-01-30 08:28:26,021 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:26,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 77157869 >2014-01-30 08:28:26,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69f2c47e >2014-01-30 08:28:26,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad526e3f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88837cb9}, log id: 69f2c47e >2014-01-30 08:28:29,551 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:31,042 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-53) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:31,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27341aa8 >2014-01-30 08:28:32,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 27341aa8 >2014-01-30 08:28:32,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7a1608 >2014-01-30 08:28:32,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2915448, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f45ca09b}, log id: 7a1608 >2014-01-30 08:28:34,571 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:36,063 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:37,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9e8d9ce >2014-01-30 08:28:37,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 9e8d9ce >2014-01-30 08:28:37,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 480d228d >2014-01-30 08:28:38,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7023cb0e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e03a9515}, log id: 480d228d >2014-01-30 08:28:39,592 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:41,088 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:43,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7bf6f512 >2014-01-30 08:28:43,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7bf6f512 >2014-01-30 08:28:43,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 287da1a4 >2014-01-30 08:28:44,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@979d8997, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@180e61f5}, log id: 287da1a4 >2014-01-30 08:28:44,613 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:46,106 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:47,219 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) [23554188] No up server in cluster >2014-01-30 08:28:47,220 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) [23554188] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:28:47,223 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) [23554188] No up server in cluster >2014-01-30 08:28:47,223 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) [23554188] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:28:47,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 2fc95be8 >2014-01-30 08:28:47,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 2fc95be8 >2014-01-30 08:28:47,791 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-9) [23554188] No up server in cluster >2014-01-30 08:28:47,791 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-9) [23554188] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:28:49,109 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c991352 >2014-01-30 08:28:49,592 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7c991352 >2014-01-30 08:28:49,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 626ae826 >2014-01-30 08:28:49,635 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:49,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71bd690b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c0e214b}, log id: 626ae826 >2014-01-30 08:28:51,125 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:54,654 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:54,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 144213a2 >2014-01-30 08:28:55,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 144213a2 >2014-01-30 08:28:55,438 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51d58e7f >2014-01-30 08:28:55,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9ff2907, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a8442790}, log id: 51d58e7f >2014-01-30 08:28:56,149 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:28:59,674 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:00,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 542dd37a >2014-01-30 08:29:01,167 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:01,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 542dd37a >2014-01-30 08:29:01,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 419a786e >2014-01-30 08:29:01,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54b75cc0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4d5a172}, log id: 419a786e >2014-01-30 08:29:04,694 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:06,185 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:06,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ee274d8 >2014-01-30 08:29:07,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2ee274d8 >2014-01-30 08:29:07,051 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59b683ff >2014-01-30 08:29:07,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4847c05, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84301443}, log id: 59b683ff >2014-01-30 08:29:09,711 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-50) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:11,204 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:12,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5720d47b >2014-01-30 08:29:12,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5720d47b >2014-01-30 08:29:12,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 752771bc >2014-01-30 08:29:13,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@654c63a7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a48302e}, log id: 752771bc >2014-01-30 08:29:14,731 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:16,224 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-45) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:18,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a0d317 >2014-01-30 08:29:18,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3a0d317 >2014-01-30 08:29:18,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f78e87a >2014-01-30 08:29:18,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@202a7c8d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1041051c}, log id: 3f78e87a >2014-01-30 08:29:19,751 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:21,245 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:23,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1303952 >2014-01-30 08:29:24,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1303952 >2014-01-30 08:29:24,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e3d3341 >2014-01-30 08:29:24,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3c38043, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e27c7b01}, log id: 2e3d3341 >2014-01-30 08:29:24,772 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-4) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:26,265 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:29,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6bacc4d0 >2014-01-30 08:29:29,789 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:30,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6bacc4d0 >2014-01-30 08:29:30,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2fe1ff42 >2014-01-30 08:29:30,526 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@934a0140, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f363c31}, log id: 2fe1ff42 >2014-01-30 08:29:31,287 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:34,805 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:35,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31a4e044 >2014-01-30 08:29:36,056 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 31a4e044 >2014-01-30 08:29:36,062 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2da8b3bf >2014-01-30 08:29:36,307 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:36,337 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a238b55, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36dc4be5}, log id: 2da8b3bf >2014-01-30 08:29:39,825 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:41,329 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:41,385 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2bf388b6 >2014-01-30 08:29:41,875 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2bf388b6 >2014-01-30 08:29:41,882 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 786e11ae >2014-01-30 08:29:42,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f505505e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f05d95b}, log id: 786e11ae >2014-01-30 08:29:44,846 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:46,347 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:47,205 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b3d6f02 >2014-01-30 08:29:47,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4b3d6f02 >2014-01-30 08:29:47,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 587e9a84 >2014-01-30 08:29:47,797 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) [5049497] No up server in cluster >2014-01-30 08:29:47,797 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) [5049497] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:29:47,799 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) [5049497] No up server in cluster >2014-01-30 08:29:47,799 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) [5049497] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:29:47,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 34e35c78 >2014-01-30 08:29:47,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3fd438b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f06f2dee}, log id: 587e9a84 >2014-01-30 08:29:48,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 34e35c78 >2014-01-30 08:29:48,357 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) [5049497] No up server in cluster >2014-01-30 08:29:48,357 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) [5049497] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:29:49,865 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:51,367 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:53,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 617b2b >2014-01-30 08:29:53,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 617b2b >2014-01-30 08:29:53,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10cfe262 >2014-01-30 08:29:53,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bb6fbdf2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47a9c4b9}, log id: 10cfe262 >2014-01-30 08:29:54,921 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-53) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:56,389 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:29:58,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e246e36 >2014-01-30 08:29:59,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1e246e36 >2014-01-30 08:29:59,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6324b283 >2014-01-30 08:29:59,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4ecc334, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c540781}, log id: 6324b283 >2014-01-30 08:29:59,942 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:01,410 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:04,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f4bbf99 >2014-01-30 08:30:04,963 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:05,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5f4bbf99 >2014-01-30 08:30:05,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5568c99b >2014-01-30 08:30:05,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6c5c892, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aa3c84c3}, log id: 5568c99b >2014-01-30 08:30:06,431 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:09,981 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:10,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 146dd44a >2014-01-30 08:30:10,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 146dd44a >2014-01-30 08:30:10,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b26045d >2014-01-30 08:30:11,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eba430c5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f224c74a}, log id: 2b26045d >2014-01-30 08:30:11,452 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:15,002 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:16,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78eed5a0 >2014-01-30 08:30:16,471 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:16,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 78eed5a0 >2014-01-30 08:30:16,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 186db221 >2014-01-30 08:30:16,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@61a94ad7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eadacc15}, log id: 186db221 >2014-01-30 08:30:20,022 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:21,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 726ccc95 >2014-01-30 08:30:21,490 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:21,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2316cab2, log id: 726ccc95 >2014-01-30 08:30:21,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 2d557e1d >2014-01-30 08:30:21,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@234694da, log id: 2d557e1d >2014-01-30 08:30:22,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e751ff7 >2014-01-30 08:30:22,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6e751ff7 >2014-01-30 08:30:22,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44a75485 >2014-01-30 08:30:22,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c2896e6b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c334ec76}, log id: 44a75485 >2014-01-30 08:30:25,040 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:26,508 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:27,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48eca06a >2014-01-30 08:30:28,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 48eca06a >2014-01-30 08:30:28,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3987b133 >2014-01-30 08:30:28,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6dabbae1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ab45e2e}, log id: 3987b133 >2014-01-30 08:30:30,059 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:31,528 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:33,611 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3468ea33 >2014-01-30 08:30:34,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3468ea33 >2014-01-30 08:30:34,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1303da65 >2014-01-30 08:30:34,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f2f172f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c017dd84}, log id: 1303da65 >2014-01-30 08:30:35,079 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:36,548 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:39,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c25de3d >2014-01-30 08:30:39,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2c25de3d >2014-01-30 08:30:39,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c3745f1 >2014-01-30 08:30:40,100 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:40,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2dca2d58, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17003a19}, log id: 5c3745f1 >2014-01-30 08:30:41,568 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:45,116 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:45,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 488b7baa >2014-01-30 08:30:45,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 488b7baa >2014-01-30 08:30:45,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41d02399 >2014-01-30 08:30:45,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adfab4fc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8929a4ed}, log id: 41d02399 >2014-01-30 08:30:46,587 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:48,366 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] No up server in cluster >2014-01-30 08:30:48,367 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:30:48,369 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] No up server in cluster >2014-01-30 08:30:48,370 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:30:48,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59c03d6d >2014-01-30 08:30:48,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 59c03d6d >2014-01-30 08:30:48,917 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] No up server in cluster >2014-01-30 08:30:48,918 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:30:50,135 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:50,997 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44b62e8f >2014-01-30 08:30:51,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 44b62e8f >2014-01-30 08:30:51,475 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d673170 >2014-01-30 08:30:51,605 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:51,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ec52753, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a55f37f}, log id: 5d673170 >2014-01-30 08:30:55,158 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:56,622 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:30:56,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b82a1f7 >2014-01-30 08:30:57,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2b82a1f7 >2014-01-30 08:30:57,259 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51ab1bca >2014-01-30 08:30:57,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5554ded0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed6f0e5}, log id: 51ab1bca >2014-01-30 08:31:00,178 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:31:01,641 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:31:02,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68e4a96 >2014-01-30 08:31:03,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 68e4a96 >2014-01-30 08:31:03,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 728df540 >2014-01-30 08:31:03,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f71472d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17d65f90}, log id: 728df540 >2014-01-30 08:31:05,200 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:31:06,660 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:31:08,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7309f489 >2014-01-30 08:31:08,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7309f489 >2014-01-30 08:31:08,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1311792f >2014-01-30 08:31:09,121 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5cf04d54, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4191a6a6}, log id: 1311792f >2014-01-30 08:31:10,223 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:31:11,681 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:31:14,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41a6a409 >2014-01-30 08:31:14,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 41a6a409 >2014-01-30 08:31:14,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33a09999 >2014-01-30 08:31:14,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb58c859, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95b539e1}, log id: 33a09999 >2014-01-30 08:31:15,244 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-50) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:31:16,700 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:31:20,011 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 447fa4fe >2014-01-30 08:31:20,265 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-45) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:31:20,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 447fa4fe >2014-01-30 08:31:20,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 55b91bb >2014-01-30 08:31:20,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfae43c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c22493f1}, log id: 55b91bb >2014-01-30 08:31:21,723 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:31:25,287 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:31:25,835 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21e5e319 >2014-01-30 08:31:26,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 21e5e319 >2014-01-30 08:31:26,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4286089f >2014-01-30 08:31:26,575 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@acc3bd87, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea05164c}, log id: 4286089f >2014-01-30 08:31:26,742 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:31:30,308 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:31:31,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10850b5f >2014-01-30 08:31:31,763 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:31:32,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 10850b5f >2014-01-30 08:31:32,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74d3b09c >2014-01-30 08:31:32,355 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6b47be8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8b7ce90}, log id: 74d3b09c >2014-01-30 08:31:35,326 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:31:36,782 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:31:37,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f109bfa >2014-01-30 08:31:37,883 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: f109bfa >2014-01-30 08:31:37,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c4ad116 >2014-01-30 08:31:38,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f29822d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23788010}, log id: 1c4ad116 >2014-01-30 08:31:40,346 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:31:41,800 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:31:43,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ff4b7fe >2014-01-30 08:31:43,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2ff4b7fe >2014-01-30 08:31:43,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d65f046 >2014-01-30 08:31:43,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5621d3b1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77b3296d}, log id: d65f046 >2014-01-30 08:31:45,366 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:31:46,819 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:31:48,924 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-20) No up server in cluster >2014-01-30 08:31:48,924 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-20) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:31:48,927 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-20) No up server in cluster >2014-01-30 08:31:48,927 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-20) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:31:48,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 6698abab >2014-01-30 08:31:49,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a97b435 >2014-01-30 08:31:49,459 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 6698abab >2014-01-30 08:31:49,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: a97b435 >2014-01-30 08:31:49,474 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ca5b3a5 >2014-01-30 08:31:49,477 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-20) No up server in cluster >2014-01-30 08:31:49,477 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-20) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:31:49,751 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@170f4d09, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@408530ee}, log id: 7ca5b3a5 >2014-01-30 08:31:50,388 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:31:51,840 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:31:54,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37ef515d >2014-01-30 08:31:55,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 37ef515d >2014-01-30 08:31:55,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65a689be >2014-01-30 08:31:55,410 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:31:55,559 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70d7cd3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c2edd20}, log id: 65a689be >2014-01-30 08:31:56,859 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-39) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:00,425 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-51) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:00,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b5cf90c >2014-01-30 08:32:01,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7b5cf90c >2014-01-30 08:32:01,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e3820d4 >2014-01-30 08:32:01,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@904e1b9d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a25d3373}, log id: 1e3820d4 >2014-01-30 08:32:01,880 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:05,447 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:06,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43ca24f7 >2014-01-30 08:32:06,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43ca24f7 >2014-01-30 08:32:06,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ed76819 >2014-01-30 08:32:06,900 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-68) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:07,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a1e453, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53cecc64}, log id: 1ed76819 >2014-01-30 08:32:10,469 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:11,920 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:12,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f6e96f5 >2014-01-30 08:32:12,673 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2f6e96f5 >2014-01-30 08:32:12,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46b6f91 >2014-01-30 08:32:12,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@663e01a7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e65a1f12}, log id: 46b6f91 >2014-01-30 08:32:15,490 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:16,939 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:18,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a04c8ab >2014-01-30 08:32:18,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1a04c8ab >2014-01-30 08:32:18,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74baf815 >2014-01-30 08:32:18,788 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@89e6239b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7e859bc}, log id: 74baf815 >2014-01-30 08:32:20,514 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:21,958 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:23,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c0709c8 >2014-01-30 08:32:24,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c0709c8 >2014-01-30 08:32:24,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f01e5ee >2014-01-30 08:32:24,597 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@488e3d23, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1cfd20a}, log id: f01e5ee >2014-01-30 08:32:25,537 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:26,979 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:29,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 56cd5eb2 >2014-01-30 08:32:30,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 56cd5eb2 >2014-01-30 08:32:30,143 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5547a0a5 >2014-01-30 08:32:30,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd4b844f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67b34514}, log id: 5547a0a5 >2014-01-30 08:32:30,554 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:32,001 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:35,479 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50e7ae16 >2014-01-30 08:32:35,578 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:35,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 50e7ae16 >2014-01-30 08:32:35,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ca817d9 >2014-01-30 08:32:36,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@359d7048, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a2d85727}, log id: 1ca817d9 >2014-01-30 08:32:37,022 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:40,597 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:41,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e27015d >2014-01-30 08:32:41,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e27015d >2014-01-30 08:32:41,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e74b9a3 >2014-01-30 08:32:42,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3be2803, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6dddd75}, log id: 1e74b9a3 >2014-01-30 08:32:42,046 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:45,620 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:47,060 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:47,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11847031 >2014-01-30 08:32:47,534 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 11847031 >2014-01-30 08:32:47,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 35a0cfd >2014-01-30 08:32:47,804 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d434b9a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@816ea04b}, log id: 35a0cfd >2014-01-30 08:32:49,486 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-44) [221fed7d] No up server in cluster >2014-01-30 08:32:49,487 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-44) [221fed7d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:32:49,490 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-44) [221fed7d] No up server in cluster >2014-01-30 08:32:49,490 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-44) [221fed7d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:32:49,497 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 647aaa48 >2014-01-30 08:32:50,057 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 647aaa48 >2014-01-30 08:32:50,074 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-44) [221fed7d] No up server in cluster >2014-01-30 08:32:50,074 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-44) [221fed7d] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:32:50,642 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:52,080 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:52,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3aad226d >2014-01-30 08:32:53,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3aad226d >2014-01-30 08:32:53,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2fc7a9e0 >2014-01-30 08:32:53,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca5caebb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33a2b034}, log id: 2fc7a9e0 >2014-01-30 08:32:55,662 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:57,100 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:32:58,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f6e9c94 >2014-01-30 08:32:59,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7f6e9c94 >2014-01-30 08:32:59,139 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a7a32d2 >2014-01-30 08:32:59,409 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11f9b219, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@260b8384}, log id: 6a7a32d2 >2014-01-30 08:33:00,686 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-69) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:02,116 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:04,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e23c324 >2014-01-30 08:33:04,949 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3e23c324 >2014-01-30 08:33:04,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a5f9257 >2014-01-30 08:33:05,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cb44cf7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7470a40}, log id: 1a5f9257 >2014-01-30 08:33:05,705 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:07,134 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:10,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11aa7baf >2014-01-30 08:33:10,725 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:10,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 11aa7baf >2014-01-30 08:33:10,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29bd094c >2014-01-30 08:33:11,030 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8701096f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3867fd49}, log id: 29bd094c >2014-01-30 08:33:12,155 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:15,747 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:16,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27f6df69 >2014-01-30 08:33:16,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 27f6df69 >2014-01-30 08:33:16,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44308d0a >2014-01-30 08:33:16,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6a5e7c4d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@57ddce7a}, log id: 44308d0a >2014-01-30 08:33:17,177 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:20,766 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:21,884 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d9a6c8b >2014-01-30 08:33:22,198 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-70) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:22,368 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4d9a6c8b >2014-01-30 08:33:22,372 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51b0acb8 >2014-01-30 08:33:22,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95e6c516, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88d8cfc9}, log id: 51b0acb8 >2014-01-30 08:33:25,786 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:27,216 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:27,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72e3d82 >2014-01-30 08:33:28,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 72e3d82 >2014-01-30 08:33:28,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d2e2597 >2014-01-30 08:33:28,462 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@707385e5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35a1aff3}, log id: 1d2e2597 >2014-01-30 08:33:30,806 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:32,235 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-4) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:33,511 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c42085b >2014-01-30 08:33:34,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: c42085b >2014-01-30 08:33:34,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f72a4af >2014-01-30 08:33:34,300 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8d17661a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@178689ee}, log id: 5f72a4af >2014-01-30 08:33:35,825 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:37,256 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:39,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42c337b1 >2014-01-30 08:33:39,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 42c337b1 >2014-01-30 08:33:39,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c1fbd72 >2014-01-30 08:33:40,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c218242, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6fed68ae}, log id: 7c1fbd72 >2014-01-30 08:33:40,846 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-73) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:42,278 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-31) [4cd69e9b] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:45,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26e90806 >2014-01-30 08:33:45,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 26e90806 >2014-01-30 08:33:45,682 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54e6bda4 >2014-01-30 08:33:45,867 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:45,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b916a35a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2ab83bb}, log id: 54e6bda4 >2014-01-30 08:33:47,299 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:50,081 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-20) No up server in cluster >2014-01-30 08:33:50,081 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-20) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:33:50,084 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-20) No up server in cluster >2014-01-30 08:33:50,084 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-20) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:33:50,090 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 38a3d8f3 >2014-01-30 08:33:50,607 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-20) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 38a3d8f3 >2014-01-30 08:33:50,621 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-20) No up server in cluster >2014-01-30 08:33:50,621 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-20) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:33:50,888 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:51,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7647707a >2014-01-30 08:33:51,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7647707a >2014-01-30 08:33:51,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65536e34 >2014-01-30 08:33:51,775 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e40de76, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cae299de}, log id: 65536e34 >2014-01-30 08:33:52,320 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:55,908 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:56,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: dfe67b7 >2014-01-30 08:33:57,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: dfe67b7 >2014-01-30 08:33:57,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3cbae88 >2014-01-30 08:33:57,340 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:33:57,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b533afb8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@54335f6c}, log id: 3cbae88 >2014-01-30 08:34:00,928 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:34:02,358 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-53) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:34:02,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 553db472 >2014-01-30 08:34:03,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 553db472 >2014-01-30 08:34:03,102 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58f4035c >2014-01-30 08:34:03,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c4261a1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@81ad5b7a}, log id: 58f4035c >2014-01-30 08:34:05,952 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-51) Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:34:07,377 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:34:08,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 34b83a15 >2014-01-30 08:34:08,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 34b83a15 >2014-01-30 08:34:08,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a3b9933 >2014-01-30 08:34:09,134 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (pool-5-thread-25) [e1fc59e] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 45e42dfd-602d-47ea-ad35-9ee3ce83655e Type: VDS >2014-01-30 08:34:09,159 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (pool-5-thread-25) [e1fc59e] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 45e42dfd-602d-47ea-ad35-9ee3ce83655e Type: VDS >2014-01-30 08:34:09,163 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-25) [e1fc59e] START, SetVdsStatusVDSCommand(HostName = 10.70.37.158, HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e, status=Maintenance, nonOperationalReason=NONE), log id: 2a866dac >2014-01-30 08:34:09,236 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5692254, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94b1325f}, log id: 6a3b9933 >2014-01-30 08:34:10,973 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:34:10,988 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-25) [e1fc59e] FINISH, SetVdsStatusVDSCommand, log id: 2a866dac >2014-01-30 08:34:10,994 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-25) [e1fc59e] Correlation ID: e1fc59e, Job ID: bd35553d-6496-4e69-8cdd-5fdf47c02977, Call Stack: null, Custom Event ID: -1, Message: Host 10.70.37.158 was switched to Maintenance mode by admin@internal. >2014-01-30 08:34:12,397 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:34:14,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a081ce3 >2014-01-30 08:34:14,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3a081ce3 >2014-01-30 08:34:14,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1477da85 >2014-01-30 08:34:15,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb27cdc4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1ae24da}, log id: 1477da85 >2014-01-30 08:34:17,277 INFO [org.ovirt.engine.core.bll.MaintenanceNumberOfVdssCommand] (pool-5-thread-25) [4e6af8e5] Running command: MaintenanceNumberOfVdssCommand internal: false. Entities affected : ID: 93ecedfe-3409-43cf-a0b2-b2247948eb75 Type: VDS >2014-01-30 08:34:17,303 INFO [org.ovirt.engine.core.bll.MaintenanceVdsCommand] (pool-5-thread-25) [4e6af8e5] Running command: MaintenanceVdsCommand internal: true. Entities affected : ID: 93ecedfe-3409-43cf-a0b2-b2247948eb75 Type: VDS >2014-01-30 08:34:17,308 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-25) [4e6af8e5] START, SetVdsStatusVDSCommand(HostName = host1, HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75, status=Maintenance, nonOperationalReason=NONE), log id: ace2d84 >2014-01-30 08:34:17,417 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] Command GetCapabilitiesVDS execution failed. Exception: VDSNetworkException: java.net.SocketTimeoutException: connect timed out >2014-01-30 08:34:17,433 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (pool-5-thread-25) [4e6af8e5] FINISH, SetVdsStatusVDSCommand, log id: ace2d84 >2014-01-30 08:34:17,437 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-25) [4e6af8e5] Correlation ID: 4e6af8e5, Job ID: c55abcd2-435d-4705-9aaa-69ae03cbe86a, Call Stack: null, Custom Event ID: -1, Message: Host host1 was switched to Maintenance mode by admin@internal. >2014-01-30 08:34:20,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d1b7650 >2014-01-30 08:34:20,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5d1b7650 >2014-01-30 08:34:20,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c636e35 >2014-01-30 08:34:20,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@228ddd5c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcac77f0}, log id: 2c636e35 >2014-01-30 08:34:22,474 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-1) [42bf48e] Lock Acquired to object EngineLock [exclusiveLocks= key: 45e42dfd-602d-47ea-ad35-9ee3ce83655e value: VDS >, sharedLocks= ] >2014-01-30 08:34:22,491 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-5-thread-25) [42bf48e] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 45e42dfd-602d-47ea-ad35-9ee3ce83655e Type: VDS >2014-01-30 08:34:22,511 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-25) [42bf48e] START, RemoveVdsVDSCommand( HostId = 45e42dfd-602d-47ea-ad35-9ee3ce83655e), log id: 1c8e9ede >2014-01-30 08:34:22,511 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-5-thread-25) [42bf48e] vdsManager::disposing >2014-01-30 08:34:22,511 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-25) [42bf48e] FINISH, RemoveVdsVDSCommand, log id: 1c8e9ede >2014-01-30 08:34:22,514 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-25) [42bf48e] Correlation ID: 42bf48e, Call Stack: null, Custom Event ID: -1, Message: Host 10.70.37.158 was removed by admin@internal. >2014-01-30 08:34:22,514 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-5-thread-25) [42bf48e] Lock freed to object EngineLock [exclusiveLocks= key: 45e42dfd-602d-47ea-ad35-9ee3ce83655e value: VDS >, sharedLocks= ] >2014-01-30 08:34:25,847 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (ajp-/127.0.0.1:8702-3) [6557cb30] Lock Acquired to object EngineLock [exclusiveLocks= key: 93ecedfe-3409-43cf-a0b2-b2247948eb75 value: VDS >, sharedLocks= ] >2014-01-30 08:34:25,861 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-5-thread-25) [6557cb30] Running command: RemoveVdsCommand internal: false. Entities affected : ID: 93ecedfe-3409-43cf-a0b2-b2247948eb75 Type: VDS >2014-01-30 08:34:25,876 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3bac9d2b >2014-01-30 08:34:25,879 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-25) [6557cb30] START, RemoveVdsVDSCommand( HostId = 93ecedfe-3409-43cf-a0b2-b2247948eb75), log id: 53076df6 >2014-01-30 08:34:25,880 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (pool-5-thread-25) [6557cb30] vdsManager::disposing >2014-01-30 08:34:25,880 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand] (pool-5-thread-25) [6557cb30] FINISH, RemoveVdsVDSCommand, log id: 53076df6 >2014-01-30 08:34:25,885 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-25) [6557cb30] Correlation ID: 6557cb30, Call Stack: null, Custom Event ID: -1, Message: Host host1 was removed by admin@internal. >2014-01-30 08:34:25,885 INFO [org.ovirt.engine.core.bll.RemoveVdsCommand] (pool-5-thread-25) [6557cb30] Lock freed to object EngineLock [exclusiveLocks= key: 93ecedfe-3409-43cf-a0b2-b2247948eb75 value: VDS >, sharedLocks= ] >2014-01-30 08:34:26,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3bac9d2b >2014-01-30 08:34:26,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 769886cf >2014-01-30 08:34:26,647 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c02f18f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0f15922}, log id: 769886cf >2014-01-30 08:34:31,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25947ca2 >2014-01-30 08:34:32,186 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 25947ca2 >2014-01-30 08:34:32,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3bbdf47b >2014-01-30 08:34:32,469 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fd6c157, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c9ea427}, log id: 3bbdf47b >2014-01-30 08:34:34,300 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-5-thread-25) [5ffa4783] Start running CanDoAction for command number 2/2 (Command type: RemoveVdsGroup) >2014-01-30 08:34:34,300 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-5-thread-37) [315b4895] Start running CanDoAction for command number 1/2 (Command type: RemoveVdsGroup) >2014-01-30 08:34:34,320 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-5-thread-25) [5ffa4783] Finish handling CanDoAction for command number 2/2 (Command type: RemoveVdsGroup) >2014-01-30 08:34:34,323 INFO [org.ovirt.engine.core.bll.MultipleActionsRunner] (pool-5-thread-37) [315b4895] Finish handling CanDoAction for command number 1/2 (Command type: RemoveVdsGroup) >2014-01-30 08:34:34,325 INFO [org.ovirt.engine.core.bll.RemoveVdsGroupCommand] (pool-5-thread-25) [315b4895] Running command: RemoveVdsGroupCommand internal: false. Entities affected : ID: b1c1060f-4062-4295-8ef3-5017a59e097d Type: VdsGroups >2014-01-30 08:34:34,337 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-25) [315b4895] Correlation ID: 315b4895, Call Stack: null, Custom Event ID: -1, Message: Host cluster test_1 was removed by admin@internal >2014-01-30 08:34:34,337 INFO [org.ovirt.engine.core.bll.RemoveVdsGroupCommand] (pool-5-thread-25) [5ffa4783] Running command: RemoveVdsGroupCommand internal: false. Entities affected : ID: f4553d97-d9b7-4ef6-abae-aef9124eff9d Type: VdsGroups >2014-01-30 08:34:34,354 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-5-thread-25) [5ffa4783] Correlation ID: 5ffa4783, Call Stack: null, Custom Event ID: -1, Message: Host cluster test_3 was removed by admin@internal >2014-01-30 08:34:37,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d255244 >2014-01-30 08:34:37,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7d255244 >2014-01-30 08:34:38,004 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21e8f215 >2014-01-30 08:34:38,269 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@919553ca, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@93fe04d2}, log id: 21e8f215 >2014-01-30 08:34:43,302 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: cd1e44a >2014-01-30 08:34:43,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: cd1e44a >2014-01-30 08:34:43,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a75144c >2014-01-30 08:34:44,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f0930a17, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@197f30d7}, log id: a75144c >2014-01-30 08:34:49,111 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16f1ae09 >2014-01-30 08:34:49,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 16f1ae09 >2014-01-30 08:34:49,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 677914ea >2014-01-30 08:34:49,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd500ce9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f46f9f73}, log id: 677914ea >2014-01-30 08:34:50,628 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-51) No up server in cluster >2014-01-30 08:34:50,628 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-51) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:34:50,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 52c5e91e >2014-01-30 08:34:51,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterTasksListVDSCommand, return: [GlusterAsyncTask[4518561a-4267-46c9-a480-80c373e983f4-REMOVE_BRICK-FINISHED]], log id: 52c5e91e >2014-01-30 08:34:54,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49b944e8 >2014-01-30 08:34:55,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 49b944e8 >2014-01-30 08:34:55,403 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d14f6f2 >2014-01-30 08:34:55,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10cc4277, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e51b1ffb}, log id: 4d14f6f2 >2014-01-30 08:35:00,735 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77bcbf04 >2014-01-30 08:35:01,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 77bcbf04 >2014-01-30 08:35:01,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4039a18 >2014-01-30 08:35:01,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83efdfd4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e868337a}, log id: 4039a18 >2014-01-30 08:35:06,536 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3da399d5 >2014-01-30 08:35:07,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3da399d5 >2014-01-30 08:35:07,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4da3e23b >2014-01-30 08:35:07,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3e29ec0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82381372}, log id: 4da3e23b >2014-01-30 08:35:12,345 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b25a0ed >2014-01-30 08:35:12,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6b25a0ed >2014-01-30 08:35:12,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a8d0780 >2014-01-30 08:35:13,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25d8a6ef, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2349937f}, log id: 6a8d0780 >2014-01-30 08:35:18,168 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e35b238 >2014-01-30 08:35:18,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1e35b238 >2014-01-30 08:35:18,661 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b4d5968 >2014-01-30 08:35:18,732 INFO [org.ovirt.engine.core.bll.gluster.StopRemoveGlusterVolumeBricksCommand] (ajp-/127.0.0.1:8702-8) [7f17f575] Running command: StopRemoveGlusterVolumeBricksCommand internal: false. Entities affected : ID: 478842d3-8bba-456b-9097-189a1de8012c Type: GlusterVolume >2014-01-30 08:35:18,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.StopRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-8) [7f17f575] START, StopRemoveGlusterVolumeBricksVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 75b5dc49 >2014-01-30 08:35:18,950 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6ba63cb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ec2ed0a5}, log id: 1b4d5968 >2014-01-30 08:35:21,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 34ce5201 >2014-01-30 08:35:22,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@229eae17, log id: 34ce5201 >2014-01-30 08:35:22,154 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] Error while refreshing brick statuses for volume dis_rep_vol of cluster test_2: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:855) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:821) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:781) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor105.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:35:22,158 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 69ae0a6 >2014-01-30 08:35:22,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4c5628a9, log id: 69ae0a6 >2014-01-30 08:35:22,398 ERROR [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] Error while refreshing brick statuses for volume dis_vol of cluster test_2: java.lang.NullPointerException > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.getBrickStatusMap(GlusterSyncJob.java:855) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshBrickStatuses(GlusterSyncJob.java:821) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshClusterHeavyWeightData(GlusterSyncJob.java:806) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshHeavyWeightData(GlusterSyncJob.java:781) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor105.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:35:23,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3436dff >2014-01-30 08:35:24,546 INFO [org.ovirt.engine.core.vdsbroker.gluster.StopRemoveGlusterVolumeBricksVDSCommand] (ajp-/127.0.0.1:8702-8) [7f17f575] FINISH, StopRemoveGlusterVolumeBricksVDSCommand, log id: 75b5dc49 >2014-01-30 08:35:24,555 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-8) [7f17f575] Correlation ID: 7f17f575, Call Stack: null, Custom Event ID: -1, Message: Failed to stop remove bricks from Volume dis_rep_vol >2014-01-30 08:35:24,781 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3436dff >2014-01-30 08:35:24,787 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7186dd14 >2014-01-30 08:35:25,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bed31531, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@849bdcfd}, log id: 7186dd14 >2014-01-30 08:35:30,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31f14b4 >2014-01-30 08:35:30,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 31f14b4 >2014-01-30 08:35:30,578 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b25014d >2014-01-30 08:35:30,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16dabb57, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c685d0a0}, log id: 1b25014d >2014-01-30 08:35:35,889 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3cedaa92 >2014-01-30 08:35:36,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3cedaa92 >2014-01-30 08:35:36,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66aa672d >2014-01-30 08:35:36,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d163281d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d1b0ce}, log id: 66aa672d >2014-01-30 08:35:41,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 492e7e11 >2014-01-30 08:35:42,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 492e7e11 >2014-01-30 08:35:42,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 565b47c4 >2014-01-30 08:35:42,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f68496d6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c907371}, log id: 565b47c4 >2014-01-30 08:35:47,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: f642bbd >2014-01-30 08:35:48,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: f642bbd >2014-01-30 08:35:48,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 62b8a859 >2014-01-30 08:35:48,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2908627, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fd1f3dc}, log id: 62b8a859 >2014-01-30 08:35:51,193 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-11) [7cc81051] No up server in cluster >2014-01-30 08:35:51,193 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-11) [7cc81051] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:35:51,199 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 15240328 >2014-01-30 08:35:51,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterTasksListVDSCommand, return: [], log id: 15240328 >2014-01-30 08:35:51,513 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-11) [7cc81051] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: Could not find information for remove brick on volume dis_rep_vol of Cluster test_2 from CLI. Marking it as unknown. >2014-01-30 08:35:53,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d68eda1 >2014-01-30 08:35:53,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: d68eda1 >2014-01-30 08:35:53,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 346223ad >2014-01-30 08:35:54,091 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9de81d37, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72c1040a}, log id: 346223ad >2014-01-30 08:35:59,127 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 955c633 >2014-01-30 08:35:59,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 955c633 >2014-01-30 08:35:59,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4884b937 >2014-01-30 08:35:59,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@215ef2e9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7949c177}, log id: 4884b937 >2014-01-30 08:36:04,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 547c641e >2014-01-30 08:36:05,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 547c641e >2014-01-30 08:36:05,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26daba22 >2014-01-30 08:36:05,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6a99aa4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a03b9a0}, log id: 26daba22 >2014-01-30 08:36:10,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6296d091 >2014-01-30 08:36:11,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6296d091 >2014-01-30 08:36:11,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 505b158a >2014-01-30 08:36:11,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3d3672b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8895bf4c}, log id: 505b158a >2014-01-30 08:36:16,551 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3cccd923 >2014-01-30 08:36:17,022 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3cccd923 >2014-01-30 08:36:17,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9b271b3 >2014-01-30 08:36:17,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3d08ba6b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29b14376}, log id: 9b271b3 >2014-01-30 08:36:22,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c019b48 >2014-01-30 08:36:22,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1c019b48 >2014-01-30 08:36:22,831 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c4c46ea >2014-01-30 08:36:23,115 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f390824, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5dd6e3e1}, log id: 5c4c46ea >2014-01-30 08:36:28,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 61388dfd >2014-01-30 08:36:28,633 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 61388dfd >2014-01-30 08:36:28,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ffb9f30 >2014-01-30 08:36:28,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ead139a1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd8ec25f}, log id: 1ffb9f30 >2014-01-30 08:36:33,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: df70e0 >2014-01-30 08:36:34,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: df70e0 >2014-01-30 08:36:34,441 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d23ab05 >2014-01-30 08:36:34,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@52df4d73, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@45c35123}, log id: 3d23ab05 >2014-01-30 08:36:39,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d5932d1 >2014-01-30 08:36:40,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4d5932d1 >2014-01-30 08:36:40,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 63b4fcf0 >2014-01-30 08:36:40,466 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c93030e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce79d2c5}, log id: 63b4fcf0 >2014-01-30 08:36:45,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: cc023ef >2014-01-30 08:36:45,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: cc023ef >2014-01-30 08:36:45,987 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 778bb2be >2014-01-30 08:36:46,268 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3348deb0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fefdb67}, log id: 778bb2be >2014-01-30 08:36:51,301 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50c26ee0 >2014-01-30 08:36:51,525 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-58) [5c017a7a] No up server in cluster >2014-01-30 08:36:51,526 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-58) [5c017a7a] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:36:51,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 209c1f4a >2014-01-30 08:36:51,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 50c26ee0 >2014-01-30 08:36:51,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 138d9406 >2014-01-30 08:36:51,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterTasksListVDSCommand, return: [], log id: 209c1f4a >2014-01-30 08:36:52,134 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a32c9d6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50f262be}, log id: 138d9406 >2014-01-30 08:36:57,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10d5abf >2014-01-30 08:36:57,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 10d5abf >2014-01-30 08:36:57,662 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51b4e150 >2014-01-30 08:36:57,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@99333b52, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccf84b10}, log id: 51b4e150 >2014-01-30 08:37:02,948 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13bf71bf >2014-01-30 08:37:03,410 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 13bf71bf >2014-01-30 08:37:03,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a57dfd2 >2014-01-30 08:37:03,671 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6098998, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2692d72}, log id: 2a57dfd2 >2014-01-30 08:37:08,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 81b3c00 >2014-01-30 08:37:09,178 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 81b3c00 >2014-01-30 08:37:09,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44365b7 >2014-01-30 08:37:09,454 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77164868, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5475883b}, log id: 44365b7 >2014-01-30 08:37:14,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 742bfb1 >2014-01-30 08:37:14,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 742bfb1 >2014-01-30 08:37:14,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38a7ef87 >2014-01-30 08:37:15,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e4b7b78a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca07c4a}, log id: 38a7ef87 >2014-01-30 08:37:20,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b2c0898 >2014-01-30 08:37:20,793 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: b2c0898 >2014-01-30 08:37:20,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f94ca3f >2014-01-30 08:37:21,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43e7c408, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad5499b2}, log id: 3f94ca3f >2014-01-30 08:37:26,112 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7831a484 >2014-01-30 08:37:26,595 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7831a484 >2014-01-30 08:37:26,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 97bac23 >2014-01-30 08:37:26,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53fb1d8f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed4753c0}, log id: 97bac23 >2014-01-30 08:37:31,925 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42954c1c >2014-01-30 08:37:32,423 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 42954c1c >2014-01-30 08:37:32,432 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74730577 >2014-01-30 08:37:32,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb544bc8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95bdb7f0}, log id: 74730577 >2014-01-30 08:37:37,748 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6985deb >2014-01-30 08:37:38,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6985deb >2014-01-30 08:37:38,245 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a1cdd35 >2014-01-30 08:37:38,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5e7b764c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cb6e92a7}, log id: 4a1cdd35 >2014-01-30 08:37:43,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 725b69b4 >2014-01-30 08:37:44,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 725b69b4 >2014-01-30 08:37:44,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f0d473b >2014-01-30 08:37:44,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75599e55, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6a5d9c6}, log id: 5f0d473b >2014-01-30 08:37:49,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76f8231b >2014-01-30 08:37:49,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 76f8231b >2014-01-30 08:37:49,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27aa44fc >2014-01-30 08:37:50,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8f90c464, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21755506}, log id: 27aa44fc >2014-01-30 08:37:51,858 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-63) [1d6d6076] No up server in cluster >2014-01-30 08:37:51,858 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-63) [1d6d6076] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:37:51,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68e968a3 >2014-01-30 08:37:52,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterTasksListVDSCommand, return: [], log id: 68e968a3 >2014-01-30 08:37:55,218 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4badb039 >2014-01-30 08:37:55,706 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4badb039 >2014-01-30 08:37:55,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 247cce05 >2014-01-30 08:37:55,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e264c39f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3304889b}, log id: 247cce05 >2014-01-30 08:38:01,018 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 381742c9 >2014-01-30 08:38:01,491 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 381742c9 >2014-01-30 08:38:01,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4177cf2e >2014-01-30 08:38:01,789 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b402e955, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11faedc7}, log id: 4177cf2e >2014-01-30 08:38:06,832 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f8119a0 >2014-01-30 08:38:07,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3f8119a0 >2014-01-30 08:38:07,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6012def9 >2014-01-30 08:38:07,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee19dde3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84e7354e}, log id: 6012def9 >2014-01-30 08:38:12,624 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2291a15b >2014-01-30 08:38:13,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2291a15b >2014-01-30 08:38:13,104 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 55ac5480 >2014-01-30 08:38:13,386 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7b5e2c54, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c34951a}, log id: 55ac5480 >2014-01-30 08:38:18,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d6d9357 >2014-01-30 08:38:18,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5d6d9357 >2014-01-30 08:38:18,907 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 10c09beb >2014-01-30 08:38:19,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7e35bca, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2b4fd1bf}, log id: 10c09beb >2014-01-30 08:38:24,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7eedcc43 >2014-01-30 08:38:24,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7eedcc43 >2014-01-30 08:38:24,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c662dd8 >2014-01-30 08:38:25,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84981404, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@28572cd6}, log id: 6c662dd8 >2014-01-30 08:38:30,080 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 746af11e >2014-01-30 08:38:30,565 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 746af11e >2014-01-30 08:38:30,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 481ce914 >2014-01-30 08:38:30,833 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dec82bc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6ea52d81}, log id: 481ce914 >2014-01-30 08:38:35,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ce1d0f5 >2014-01-30 08:38:36,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2ce1d0f5 >2014-01-30 08:38:36,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 644f84d0 >2014-01-30 08:38:36,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33a2abb5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b5080c12}, log id: 644f84d0 >2014-01-30 08:38:41,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fa7da6d >2014-01-30 08:38:42,212 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3fa7da6d >2014-01-30 08:38:42,220 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 497be9e1 >2014-01-30 08:38:42,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@629279d9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72745383}, log id: 497be9e1 >2014-01-30 08:38:47,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 768861d9 >2014-01-30 08:38:47,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 768861d9 >2014-01-30 08:38:48,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d0fe6ac >2014-01-30 08:38:48,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c7d38e9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a0791f0}, log id: 3d0fe6ac >2014-01-30 08:38:52,138 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-45) No up server in cluster >2014-01-30 08:38:52,139 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-45) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:38:52,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 51a1500e >2014-01-30 08:38:52,421 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterTasksListVDSCommand, return: [], log id: 51a1500e >2014-01-30 08:38:53,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24be91bc >2014-01-30 08:38:53,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 24be91bc >2014-01-30 08:38:53,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f33cc89 >2014-01-30 08:38:54,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aecec09f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8388c41f}, log id: 4f33cc89 >2014-01-30 08:38:59,138 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ef3e398 >2014-01-30 08:38:59,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5ef3e398 >2014-01-30 08:38:59,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 537cb18f >2014-01-30 08:38:59,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fcc3934d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd3dd1f7}, log id: 537cb18f >2014-01-30 08:39:04,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23d2966f >2014-01-30 08:39:05,411 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 23d2966f >2014-01-30 08:39:05,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14d3a658 >2014-01-30 08:39:05,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7a667d0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cfdc1bcc}, log id: 14d3a658 >2014-01-30 08:39:10,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: e003197 >2014-01-30 08:39:11,216 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: e003197 >2014-01-30 08:39:11,223 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f0abe31 >2014-01-30 08:39:11,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3433e363, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@103dec3b}, log id: 2f0abe31 >2014-01-30 08:39:16,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 250b1d6b >2014-01-30 08:39:17,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 250b1d6b >2014-01-30 08:39:17,025 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 473e02fc >2014-01-30 08:39:17,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fdc9bd4d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@756b1f6c}, log id: 473e02fc >2014-01-30 08:39:22,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: cf8aa04 >2014-01-30 08:39:22,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: cf8aa04 >2014-01-30 08:39:22,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37bb6fa7 >2014-01-30 08:39:23,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@805bf137, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4c8308f}, log id: 37bb6fa7 >2014-01-30 08:39:28,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 542defba >2014-01-30 08:39:28,655 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 542defba >2014-01-30 08:39:28,663 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 124c6a9 >2014-01-30 08:39:28,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea56547d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ace32dc2}, log id: 124c6a9 >2014-01-30 08:39:33,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64dece58 >2014-01-30 08:39:34,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 64dece58 >2014-01-30 08:39:34,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77d13b36 >2014-01-30 08:39:34,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37b0f900, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56e4d599}, log id: 77d13b36 >2014-01-30 08:39:39,797 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41948ad7 >2014-01-30 08:39:40,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 41948ad7 >2014-01-30 08:39:40,286 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30c63e1c >2014-01-30 08:39:40,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7542dbd6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@deda4c03}, log id: 30c63e1c >2014-01-30 08:39:45,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 546b8ab >2014-01-30 08:39:46,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 546b8ab >2014-01-30 08:39:46,059 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4d046ea1 >2014-01-30 08:39:46,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@502d68de, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abc23d33}, log id: 4d046ea1 >2014-01-30 08:39:51,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 307fccfd >2014-01-30 08:39:51,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 307fccfd >2014-01-30 08:39:51,881 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5fc5dc17 >2014-01-30 08:39:52,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14105ede, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@314d0a50}, log id: 5fc5dc17 >2014-01-30 08:39:52,428 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-68) No up server in cluster >2014-01-30 08:39:52,428 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-68) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:39:52,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: dab3529 >2014-01-30 08:39:52,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterTasksListVDSCommand, return: [], log id: dab3529 >2014-01-30 08:39:57,210 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31cff046 >2014-01-30 08:39:57,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 31cff046 >2014-01-30 08:39:57,712 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51bb61b8 >2014-01-30 08:39:57,976 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad330bb4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@56493746}, log id: 51bb61b8 >2014-01-30 08:40:03,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24d58e24 >2014-01-30 08:40:03,484 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 24d58e24 >2014-01-30 08:40:03,492 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b1afe50 >2014-01-30 08:40:03,767 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9f749677, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4eab1661}, log id: 6b1afe50 >2014-01-30 08:40:08,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ff70ba1 >2014-01-30 08:40:09,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6ff70ba1 >2014-01-30 08:40:09,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7216392a >2014-01-30 08:40:09,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1f71e26, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4eb61a8}, log id: 7216392a >2014-01-30 08:40:14,617 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ad42ab >2014-01-30 08:40:15,110 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5ad42ab >2014-01-30 08:40:15,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 171d897e >2014-01-30 08:40:15,378 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-6) [68531e72] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9e2dca1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f8502e9}, log id: 171d897e >2014-01-30 08:40:20,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 57ae79ae >2014-01-30 08:40:20,898 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 57ae79ae >2014-01-30 08:40:20,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7650083f >2014-01-30 08:40:21,193 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-3) [56ae6ee2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ced70a8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f607b88}, log id: 7650083f >2014-01-30 08:40:22,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1981d9ef >2014-01-30 08:40:22,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@6f4e4d7f, log id: 1981d9ef >2014-01-30 08:40:22,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7dc205ef >2014-01-30 08:40:22,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2e1c379d, log id: 7dc205ef >2014-01-30 08:40:26,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5054cbfc >2014-01-30 08:40:26,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5054cbfc >2014-01-30 08:40:26,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41c78cf2 >2014-01-30 08:40:26,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bea5db9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f02ea68}, log id: 41c78cf2 >2014-01-30 08:40:32,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2821052a >2014-01-30 08:40:32,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2821052a >2014-01-30 08:40:32,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48088c9c >2014-01-30 08:40:32,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1b74c67, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4fb2eba}, log id: 48088c9c >2014-01-30 08:40:37,829 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b71650e >2014-01-30 08:40:38,308 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6b71650e >2014-01-30 08:40:38,312 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3531fa51 >2014-01-30 08:40:38,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@491a24e4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ef70a79}, log id: 3531fa51 >2014-01-30 08:40:43,600 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25405fd2 >2014-01-30 08:40:44,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 25405fd2 >2014-01-30 08:40:44,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 790a2a54 >2014-01-30 08:40:44,364 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b66417, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dc61f7fc}, log id: 790a2a54 >2014-01-30 08:40:49,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f894eec >2014-01-30 08:40:49,885 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5f894eec >2014-01-30 08:40:49,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 679d33b0 >2014-01-30 08:40:50,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3045ad3b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca030942}, log id: 679d33b0 >2014-01-30 08:40:52,720 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-28) [3472ce94] No up server in cluster >2014-01-30 08:40:52,720 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-28) [3472ce94] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:40:52,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 339ad7e4 >2014-01-30 08:40:53,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterTasksListVDSCommand, return: [], log id: 339ad7e4 >2014-01-30 08:40:55,206 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19e93abb >2014-01-30 08:40:55,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 19e93abb >2014-01-30 08:40:55,700 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51c61653 >2014-01-30 08:40:55,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40abe71d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7bb7e17}, log id: 51c61653 >2014-01-30 08:41:01,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1aea458d >2014-01-30 08:41:01,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1aea458d >2014-01-30 08:41:01,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 73155c55 >2014-01-30 08:41:01,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9dacea0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@249976e9}, log id: 73155c55 >2014-01-30 08:41:06,825 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e4f2125 >2014-01-30 08:41:07,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3e4f2125 >2014-01-30 08:41:07,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: abbf3dd >2014-01-30 08:41:07,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24d2b1b1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@803553d8}, log id: abbf3dd >2014-01-30 08:41:12,638 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 150741dd >2014-01-30 08:41:13,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 150741dd >2014-01-30 08:41:13,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4464279 >2014-01-30 08:41:13,397 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@edabe46, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@84e9bd84}, log id: 4464279 >2014-01-30 08:41:18,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7db12142 >2014-01-30 08:41:18,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7db12142 >2014-01-30 08:41:18,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 403957fa >2014-01-30 08:41:19,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1e51bfd0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ac7cadd}, log id: 403957fa >2014-01-30 08:41:24,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c780500 >2014-01-30 08:41:24,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4c780500 >2014-01-30 08:41:24,710 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a5e7499 >2014-01-30 08:41:24,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8480d4a4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5429f721}, log id: 1a5e7499 >2014-01-30 08:41:30,027 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4be7b0d8 >2014-01-30 08:41:30,524 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4be7b0d8 >2014-01-30 08:41:30,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 70a0bd58 >2014-01-30 08:41:30,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dcb53029, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5f7a93f4}, log id: 70a0bd58 >2014-01-30 08:41:35,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51b075c5 >2014-01-30 08:41:36,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 51b075c5 >2014-01-30 08:41:36,331 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c8509b5 >2014-01-30 08:41:36,608 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9597bebb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0d214d9}, log id: 2c8509b5 >2014-01-30 08:41:41,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46ec506c >2014-01-30 08:41:42,149 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 46ec506c >2014-01-30 08:41:42,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24a9ea73 >2014-01-30 08:41:42,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-95) [79e57d6f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd3a4452, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@13526aef}, log id: 24a9ea73 >2014-01-30 08:41:47,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53c48d82 >2014-01-30 08:41:47,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 53c48d82 >2014-01-30 08:41:47,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77423889 >2014-01-30 08:41:48,233 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aac2a83c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@26860749}, log id: 77423889 >2014-01-30 08:41:53,025 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-90) [c894cd9] No up server in cluster >2014-01-30 08:41:53,025 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-90) [c894cd9] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:41:53,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 632ce9d5 >2014-01-30 08:41:53,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e9d9732 >2014-01-30 08:41:53,310 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterTasksListVDSCommand, return: [], log id: 632ce9d5 >2014-01-30 08:41:53,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e9d9732 >2014-01-30 08:41:53,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66ad165a >2014-01-30 08:41:54,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@564de19e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67fc88a9}, log id: 66ad165a >2014-01-30 08:41:59,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 75789486 >2014-01-30 08:41:59,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 75789486 >2014-01-30 08:41:59,585 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40b99c02 >2014-01-30 08:41:59,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c86ee9da, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f85269c6}, log id: 40b99c02 >2014-01-30 08:42:04,872 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5fefe661 >2014-01-30 08:42:05,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5fefe661 >2014-01-30 08:42:05,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e852ff >2014-01-30 08:42:05,631 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1b28e05, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8789a388}, log id: 1e852ff >2014-01-30 08:42:10,670 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b978e74 >2014-01-30 08:42:11,163 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2b978e74 >2014-01-30 08:42:11,171 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c9ea64a >2014-01-30 08:42:11,427 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98dd2f9a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a6e2124e}, log id: 2c9ea64a >2014-01-30 08:42:16,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2740fa0b >2014-01-30 08:42:16,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2740fa0b >2014-01-30 08:42:16,962 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 957a7f3 >2014-01-30 08:42:17,239 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48586757, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b53383cb}, log id: 957a7f3 >2014-01-30 08:42:22,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c29782a >2014-01-30 08:42:22,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4c29782a >2014-01-30 08:42:22,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 684b29da >2014-01-30 08:42:23,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d20b3035, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@91a0ba9b}, log id: 684b29da >2014-01-30 08:42:28,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 683a7e46 >2014-01-30 08:42:28,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 683a7e46 >2014-01-30 08:42:28,552 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60e2a34c >2014-01-30 08:42:28,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33d4c222, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70667fca}, log id: 60e2a34c >2014-01-30 08:42:33,213 INFO [org.ovirt.engine.core.bll.DbUserCacheManager] (DefaultQuartzScheduler_Worker-28) [3472ce94] Start refreshing all users data >2014-01-30 08:42:33,265 INFO [org.ovirt.engine.core.bll.OvfDataUpdater] (DefaultQuartzScheduler_Worker-22) [6f443883] Attempting to update VMs/Templates Ovf. >2014-01-30 08:42:33,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 684be395 >2014-01-30 08:42:34,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 684be395 >2014-01-30 08:42:34,339 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19d1be16 >2014-01-30 08:42:34,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a708d3b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46ec3469}, log id: 19d1be16 >2014-01-30 08:42:35,373 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-16) START, GlusterHooksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 7a0ba775 >2014-01-30 08:42:35,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-45) START, GlusterHooksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 64c4dfc2 >2014-01-30 08:42:35,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-25) START, GlusterHooksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 131f30ec >2014-01-30 08:42:35,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-37) START, GlusterHooksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 393e6d3d >2014-01-30 08:42:35,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-25) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@33525eb7, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@72123120, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@977de73d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@d5dff1be, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b842fa5b, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@72db9839, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@25a493f2, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b7367c5c, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@acefc371, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b4393996, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@3b30d716, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@82aefa96, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@a47e5326], log id: 131f30ec >2014-01-30 08:42:35,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-16) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@910884b7, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f1e3e087, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@514ee243, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@418b994b, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@8dbc01fa, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@9f1b2be2, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@d61d19b, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@ccf62f16, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@8d435d3a, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@7649d0fb, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@f30e2f81, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@cb95183b, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@107fcf5], log id: 7a0ba775 >2014-01-30 08:42:35,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-37) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b8ffc53c, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@2da73bae, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@fe1c919a, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@7ed4ae1e, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@e00998ef, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@e517d249, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@47ac9997, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@ce956b88, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@df33ebc4, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@b8933a7d, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@77feb18a, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@76616738, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@70522e84], log id: 393e6d3d >2014-01-30 08:42:35,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterHooksListVDSCommand] (pool-5-thread-45) FINISH, GlusterHooksListVDSCommand, return: [org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@8327edc7, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@520968e, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@8342b840, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@53d90741, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@d26c6faa, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@46cbcd31, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@5c58c79f, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@e7ca676a, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@26e47646, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@a542230e, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@6498902, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@fa9d8e24, org.ovirt.engine.core.common.businessentities.gluster.GlusterHookEntity@c97286c6], log id: 64c4dfc2 >2014-01-30 08:42:39,649 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71ff9ae4 >2014-01-30 08:42:40,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 71ff9ae4 >2014-01-30 08:42:40,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9e2b43b >2014-01-30 08:42:40,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3cdb8831, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8279174b}, log id: 9e2b43b >2014-01-30 08:42:45,442 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68653457 >2014-01-30 08:42:45,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 68653457 >2014-01-30 08:42:45,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 93db68d >2014-01-30 08:42:46,182 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a390583c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bf85b5c}, log id: 93db68d >2014-01-30 08:42:51,217 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6abe426e >2014-01-30 08:42:51,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6abe426e >2014-01-30 08:42:51,719 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 47b3f4d0 >2014-01-30 08:42:51,984 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@544fe21e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12e1992d}, log id: 47b3f4d0 >2014-01-30 08:42:53,316 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-5) [5cab3cac] No up server in cluster >2014-01-30 08:42:53,316 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-5) [5cab3cac] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:42:53,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5589a37 >2014-01-30 08:42:53,602 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterTasksListVDSCommand, return: [], log id: 5589a37 >2014-01-30 08:42:57,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30d929f9 >2014-01-30 08:42:57,501 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 30d929f9 >2014-01-30 08:42:57,509 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15841fed >2014-01-30 08:42:57,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd92cce6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14da8ddc}, log id: 15841fed >2014-01-30 08:43:02,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30352ddf >2014-01-30 08:43:03,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 30352ddf >2014-01-30 08:43:03,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46347149 >2014-01-30 08:43:03,599 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0913519, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@159bf8a5}, log id: 46347149 >2014-01-30 08:43:08,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b89b516 >2014-01-30 08:43:09,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6b89b516 >2014-01-30 08:43:09,151 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 944de53 >2014-01-30 08:43:09,444 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9bc81b1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5c2b837e}, log id: 944de53 >2014-01-30 08:43:14,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b73fce2 >2014-01-30 08:43:14,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3b73fce2 >2014-01-30 08:43:14,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8e58706 >2014-01-30 08:43:15,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d599cad, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf3beaf}, log id: 8e58706 >2014-01-30 08:43:20,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6592f8dd >2014-01-30 08:43:20,764 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6592f8dd >2014-01-30 08:43:20,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 150147cf >2014-01-30 08:43:21,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c326cd8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@258c181e}, log id: 150147cf >2014-01-30 08:43:26,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6543e2d0 >2014-01-30 08:43:26,533 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6543e2d0 >2014-01-30 08:43:26,541 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71c27add >2014-01-30 08:43:26,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed0e7f6c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8185b009}, log id: 71c27add >2014-01-30 08:43:31,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a7332a5 >2014-01-30 08:43:32,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3a7332a5 >2014-01-30 08:43:32,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51eb8102 >2014-01-30 08:43:32,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@88263334, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85a81f2e}, log id: 51eb8102 >2014-01-30 08:43:37,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a72e0dc >2014-01-30 08:43:38,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6a72e0dc >2014-01-30 08:43:38,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4eaef3a0 >2014-01-30 08:43:38,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1d5f7bc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@97103aa9}, log id: 4eaef3a0 >2014-01-30 08:43:43,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6625a201 >2014-01-30 08:43:43,944 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6625a201 >2014-01-30 08:43:43,951 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65f92458 >2014-01-30 08:43:44,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eceee672, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5a031410}, log id: 65f92458 >2014-01-30 08:43:49,255 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 45a04e8b >2014-01-30 08:43:49,743 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 45a04e8b >2014-01-30 08:43:49,749 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59795c4c >2014-01-30 08:43:50,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c5600b6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c64188f5}, log id: 59795c4c >2014-01-30 08:43:53,608 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-19) [7a87389a] No up server in cluster >2014-01-30 08:43:53,608 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-19) [7a87389a] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:43:53,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 58b00323 >2014-01-30 08:43:53,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterTasksListVDSCommand, return: [], log id: 58b00323 >2014-01-30 08:43:55,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17294e2c >2014-01-30 08:43:55,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 17294e2c >2014-01-30 08:43:55,560 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 637f99d0 >2014-01-30 08:43:55,841 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd7b0663, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9868dc8b}, log id: 637f99d0 >2014-01-30 08:44:00,880 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ccff509 >2014-01-30 08:44:01,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: ccff509 >2014-01-30 08:44:01,366 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 57c60366 >2014-01-30 08:44:01,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-89) [1642abb0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f521513b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d6160b6}, log id: 57c60366 >2014-01-30 08:44:06,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7468688f >2014-01-30 08:44:07,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7468688f >2014-01-30 08:44:07,140 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c9800e1 >2014-01-30 08:44:07,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@51c7ec03, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c53174f3}, log id: 1c9800e1 >2014-01-30 08:44:12,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 255f1ca0 >2014-01-30 08:44:12,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 255f1ca0 >2014-01-30 08:44:12,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 466dfb75 >2014-01-30 08:44:13,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@86e8c595, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb6844f3}, log id: 466dfb75 >2014-01-30 08:44:18,221 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 302569e8 >2014-01-30 08:44:18,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 302569e8 >2014-01-30 08:44:18,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f52b39a >2014-01-30 08:44:18,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a700bab1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0815f22}, log id: 3f52b39a >2014-01-30 08:44:24,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27f2390f >2014-01-30 08:44:24,518 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 27f2390f >2014-01-30 08:44:24,525 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15735426 >2014-01-30 08:44:24,808 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e86f3827, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@785ba16}, log id: 15735426 >2014-01-30 08:44:29,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f377946 >2014-01-30 08:44:30,347 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6f377946 >2014-01-30 08:44:30,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b26bc2b >2014-01-30 08:44:30,627 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-26) [7a78e8e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd8d81fa, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62ea65d6}, log id: 5b26bc2b >2014-01-30 08:44:35,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ca745de >2014-01-30 08:44:36,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7ca745de >2014-01-30 08:44:36,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51347adf >2014-01-30 08:44:36,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b7a3c03, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f81676e7}, log id: 51347adf >2014-01-30 08:44:41,458 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1da1e6db >2014-01-30 08:44:41,965 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1da1e6db >2014-01-30 08:44:41,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e9154ab >2014-01-30 08:44:42,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f37b1706, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b02ad0d2}, log id: 3e9154ab >2014-01-30 08:44:47,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3032d39 >2014-01-30 08:44:47,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3032d39 >2014-01-30 08:44:47,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74813fc >2014-01-30 08:44:48,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f1ac4a4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@914808de}, log id: 74813fc >2014-01-30 08:44:53,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 778bf4bf >2014-01-30 08:44:53,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 778bf4bf >2014-01-30 08:44:53,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6333f4fa >2014-01-30 08:44:53,847 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0bc8252, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82c6886f}, log id: 6333f4fa >2014-01-30 08:44:53,907 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] No up server in cluster >2014-01-30 08:44:53,907 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:44:53,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 59b43971 >2014-01-30 08:44:54,192 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterTasksListVDSCommand, return: [], log id: 59b43971 >2014-01-30 08:44:58,879 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3db73c1a >2014-01-30 08:44:59,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3db73c1a >2014-01-30 08:44:59,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b3e1cc9 >2014-01-30 08:44:59,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9b51dbb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8163879}, log id: b3e1cc9 >2014-01-30 08:45:04,699 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 43df595d >2014-01-30 08:45:05,173 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 43df595d >2014-01-30 08:45:05,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 763436a8 >2014-01-30 08:45:05,447 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25df58e5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d790f8c8}, log id: 763436a8 >2014-01-30 08:45:10,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4159428b >2014-01-30 08:45:10,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4159428b >2014-01-30 08:45:10,969 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5d365ee8 >2014-01-30 08:45:11,241 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cc690c7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1cd43f6}, log id: 5d365ee8 >2014-01-30 08:45:16,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e222eff >2014-01-30 08:45:16,766 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5e222eff >2014-01-30 08:45:16,771 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c99f13e >2014-01-30 08:45:17,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bfc113, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1e17347}, log id: 2c99f13e >2014-01-30 08:45:22,075 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 45c3d8bf >2014-01-30 08:45:22,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 45c3d8bf >2014-01-30 08:45:22,580 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 401918e4 >2014-01-30 08:45:22,864 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a94524a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fae5646c}, log id: 401918e4 >2014-01-30 08:45:22,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 57b3e21d >2014-01-30 08:45:23,272 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@b703a29, log id: 57b3e21d >2014-01-30 08:45:23,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 74fa5f9c >2014-01-30 08:45:23,545 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@4c65e781, log id: 74fa5f9c >2014-01-30 08:45:27,909 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49361219 >2014-01-30 08:45:28,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 49361219 >2014-01-30 08:45:28,413 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4920c763 >2014-01-30 08:45:28,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c7c604a1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29f97a28}, log id: 4920c763 >2014-01-30 08:45:33,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18474a7f >2014-01-30 08:45:34,222 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 18474a7f >2014-01-30 08:45:34,229 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e562fe0 >2014-01-30 08:45:34,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@704d5d41, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c07a193}, log id: 7e562fe0 >2014-01-30 08:45:39,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71f8bfa2 >2014-01-30 08:45:40,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 71f8bfa2 >2014-01-30 08:45:40,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12882615 >2014-01-30 08:45:40,363 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@114b4bc6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fc101799}, log id: 12882615 >2014-01-30 08:45:45,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60e5db0c >2014-01-30 08:45:45,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 60e5db0c >2014-01-30 08:45:45,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1befef6 >2014-01-30 08:45:46,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d8e3aacc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ac86e27}, log id: 1befef6 >2014-01-30 08:45:51,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fd4ae09 >2014-01-30 08:45:51,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3fd4ae09 >2014-01-30 08:45:51,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3f64dcc7 >2014-01-30 08:45:52,015 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98d1b352, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d6509ea0}, log id: 3f64dcc7 >2014-01-30 08:45:54,199 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-97) [717bad08] No up server in cluster >2014-01-30 08:45:54,199 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-97) [717bad08] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:45:54,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 3c8ab93f >2014-01-30 08:45:54,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterTasksListVDSCommand, return: [], log id: 3c8ab93f >2014-01-30 08:45:57,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64cb9a6e >2014-01-30 08:45:57,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 64cb9a6e >2014-01-30 08:45:57,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c1fa2f4 >2014-01-30 08:45:57,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@15fe8af6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f1b96ef3}, log id: 5c1fa2f4 >2014-01-30 08:46:02,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4deb9ee5 >2014-01-30 08:46:03,317 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4deb9ee5 >2014-01-30 08:46:03,325 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52833e29 >2014-01-30 08:46:03,601 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@152590be, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b44407}, log id: 52833e29 >2014-01-30 08:46:08,640 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e0b9 >2014-01-30 08:46:09,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2e0b9 >2014-01-30 08:46:09,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26d1f4ca >2014-01-30 08:46:09,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d0ba6722, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2eca3d7e}, log id: 26d1f4ca >2014-01-30 08:46:14,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e3a7ee3 >2014-01-30 08:46:14,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1e3a7ee3 >2014-01-30 08:46:14,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 157549dc >2014-01-30 08:46:15,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a00fce43, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e111caf0}, log id: 157549dc >2014-01-30 08:46:20,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72d994b1 >2014-01-30 08:46:20,704 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 72d994b1 >2014-01-30 08:46:20,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: efbd527 >2014-01-30 08:46:20,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72fb7996, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c1c7de6}, log id: efbd527 >2014-01-30 08:46:26,029 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ab3bca0 >2014-01-30 08:46:26,508 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1ab3bca0 >2014-01-30 08:46:26,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f531da8 >2014-01-30 08:46:26,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b1591d7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@aef921a8}, log id: 2f531da8 >2014-01-30 08:46:31,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b478289 >2014-01-30 08:46:32,309 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4b478289 >2014-01-30 08:46:32,318 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a0f546e >2014-01-30 08:46:32,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3d211df, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6000fba}, log id: 3a0f546e >2014-01-30 08:46:37,658 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37e70c89 >2014-01-30 08:46:38,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 37e70c89 >2014-01-30 08:46:38,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6fa74639 >2014-01-30 08:46:38,414 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf7b69ed, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8b951287}, log id: 6fa74639 >2014-01-30 08:46:43,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 142cec9 >2014-01-30 08:46:43,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 142cec9 >2014-01-30 08:46:43,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2134211b >2014-01-30 08:46:44,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9d526f3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8bfe4759}, log id: 2134211b >2014-01-30 08:46:49,226 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c215943 >2014-01-30 08:46:49,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c215943 >2014-01-30 08:46:49,713 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c8f4bcc >2014-01-30 08:46:49,985 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5d55e01c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@78e5ca9a}, log id: c8f4bcc >2014-01-30 08:46:54,489 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-71) [1ac2212e] No up server in cluster >2014-01-30 08:46:54,489 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-71) [1ac2212e] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:46:54,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 6852780e >2014-01-30 08:46:54,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterTasksListVDSCommand, return: [], log id: 6852780e >2014-01-30 08:46:55,028 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42922141 >2014-01-30 08:46:55,523 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 42922141 >2014-01-30 08:46:55,531 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 587179bd >2014-01-30 08:46:55,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a238081, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43b7fb4b}, log id: 587179bd >2014-01-30 08:47:00,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a8a71d5 >2014-01-30 08:47:01,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3a8a71d5 >2014-01-30 08:47:01,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6da7ab >2014-01-30 08:47:01,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a25e406a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d08d4fae}, log id: 6da7ab >2014-01-30 08:47:06,660 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 628110f9 >2014-01-30 08:47:07,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 628110f9 >2014-01-30 08:47:07,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 303b031 >2014-01-30 08:47:07,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1f42b27a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5cd6ff03}, log id: 303b031 >2014-01-30 08:47:12,460 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a9d0a73 >2014-01-30 08:47:12,957 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3a9d0a73 >2014-01-30 08:47:12,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c804e32 >2014-01-30 08:47:13,240 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2bfe902c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23c0597d}, log id: 3c804e32 >2014-01-30 08:47:18,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26a796a7 >2014-01-30 08:47:18,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 26a796a7 >2014-01-30 08:47:18,765 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77d5b512 >2014-01-30 08:47:19,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf1b0739, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d494c84f}, log id: 77d5b512 >2014-01-30 08:47:24,065 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38003b77 >2014-01-30 08:47:24,563 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 38003b77 >2014-01-30 08:47:24,571 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1fcd7dd4 >2014-01-30 08:47:24,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d09656f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be694ddd}, log id: 1fcd7dd4 >2014-01-30 08:47:29,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44e5d766 >2014-01-30 08:47:30,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 44e5d766 >2014-01-30 08:47:30,354 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 23e01590 >2014-01-30 08:47:30,626 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c814a3c4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69eca83b}, log id: 23e01590 >2014-01-30 08:47:35,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8f9fc9f >2014-01-30 08:47:36,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 8f9fc9f >2014-01-30 08:47:36,160 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c545784 >2014-01-30 08:47:36,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b84e1424, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1214f566}, log id: 5c545784 >2014-01-30 08:47:41,481 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22cd1605 >2014-01-30 08:47:41,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 22cd1605 >2014-01-30 08:47:41,982 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a0c5366 >2014-01-30 08:47:42,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cf0fe335, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c333c436}, log id: 3a0c5366 >2014-01-30 08:47:47,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ea66ccd >2014-01-30 08:47:47,794 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3ea66ccd >2014-01-30 08:47:47,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d14b0fd >2014-01-30 08:47:48,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9c0e8868, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8db0b8e2}, log id: d14b0fd >2014-01-30 08:47:53,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f1db159 >2014-01-30 08:47:53,618 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4f1db159 >2014-01-30 08:47:53,623 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d120412 >2014-01-30 08:47:53,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@47561bea, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fcc3bc5}, log id: d120412 >2014-01-30 08:47:54,779 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-18) [68161e48] No up server in cluster >2014-01-30 08:47:54,779 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-18) [68161e48] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:47:54,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 4e32c409 >2014-01-30 08:47:55,081 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterTasksListVDSCommand, return: [], log id: 4e32c409 >2014-01-30 08:47:58,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 820057d >2014-01-30 08:47:59,429 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 820057d >2014-01-30 08:47:59,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 42762a55 >2014-01-30 08:47:59,723 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@421a270c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a2cfff0}, log id: 42762a55 >2014-01-30 08:48:04,762 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44e3739c >2014-01-30 08:48:05,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 44e3739c >2014-01-30 08:48:05,264 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e6bc4fa >2014-01-30 08:48:05,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8e412900, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@70b608aa}, log id: 6e6bc4fa >2014-01-30 08:48:10,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: fd6f89 >2014-01-30 08:48:11,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: fd6f89 >2014-01-30 08:48:11,082 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 657b9cb2 >2014-01-30 08:48:11,350 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c8da60d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@564762dc}, log id: 657b9cb2 >2014-01-30 08:48:16,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5fce5524 >2014-01-30 08:48:16,896 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5fce5524 >2014-01-30 08:48:16,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3317f361 >2014-01-30 08:48:17,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43d002f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c1aab589}, log id: 3317f361 >2014-01-30 08:48:22,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 102045fa >2014-01-30 08:48:22,737 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 102045fa >2014-01-30 08:48:22,746 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67b8dd9d >2014-01-30 08:48:23,008 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a42143bc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de41d8eb}, log id: 67b8dd9d >2014-01-30 08:48:28,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ffa1737 >2014-01-30 08:48:28,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4ffa1737 >2014-01-30 08:48:28,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 49d0fd13 >2014-01-30 08:48:28,819 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a755897f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6b9b6cb4}, log id: 49d0fd13 >2014-01-30 08:48:33,863 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f6f0ae2 >2014-01-30 08:48:34,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6f6f0ae2 >2014-01-30 08:48:34,370 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c78c818 >2014-01-30 08:48:34,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64934b92, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2e8aa794}, log id: 1c78c818 >2014-01-30 08:48:39,668 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ec42544 >2014-01-30 08:48:40,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: ec42544 >2014-01-30 08:48:40,161 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: eb10733 >2014-01-30 08:48:40,452 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cc6662b4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ad56e94}, log id: eb10733 >2014-01-30 08:48:45,495 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 45a2ee82 >2014-01-30 08:48:45,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 45a2ee82 >2014-01-30 08:48:45,992 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16a31fbe >2014-01-30 08:48:46,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3b4a098, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@550eb48}, log id: 16a31fbe >2014-01-30 08:48:51,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5fc3fac >2014-01-30 08:48:51,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5fc3fac >2014-01-30 08:48:51,811 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52d68a68 >2014-01-30 08:48:52,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@978add3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb1a285}, log id: 52d68a68 >2014-01-30 08:48:55,088 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-77) [7c43042] No up server in cluster >2014-01-30 08:48:55,088 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-77) [7c43042] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:48:55,096 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 74737d4b >2014-01-30 08:48:55,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterTasksListVDSCommand, return: [], log id: 74737d4b >2014-01-30 08:48:57,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d58c522 >2014-01-30 08:48:57,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6d58c522 >2014-01-30 08:48:57,620 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 621ec102 >2014-01-30 08:48:57,891 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-52) [2414cdcb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@598d9d2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a252c74}, log id: 621ec102 >2014-01-30 08:49:02,935 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b6fd4ba >2014-01-30 08:49:03,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b6fd4ba >2014-01-30 08:49:03,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 170c4833 >2014-01-30 08:49:03,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23053732, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94cec4a8}, log id: 170c4833 >2014-01-30 08:49:08,768 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71f2603f >2014-01-30 08:49:09,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 71f2603f >2014-01-30 08:49:09,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d30a0bd >2014-01-30 08:49:09,557 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8cd0521d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d978f11a}, log id: 7d30a0bd >2014-01-30 08:49:14,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1b147bae >2014-01-30 08:49:15,085 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1b147bae >2014-01-30 08:49:15,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 675018b7 >2014-01-30 08:49:15,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@369ad1a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b560afa}, log id: 675018b7 >2014-01-30 08:49:20,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 96cf14c >2014-01-30 08:49:20,870 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 96cf14c >2014-01-30 08:49:20,877 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27e862ee >2014-01-30 08:49:21,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@25e02714, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c171b4e4}, log id: 27e862ee >2014-01-30 08:49:26,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 81a5524 >2014-01-30 08:49:26,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 81a5524 >2014-01-30 08:49:26,681 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b71f39 >2014-01-30 08:49:26,961 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36ccde39, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce324312}, log id: 5b71f39 >2014-01-30 08:49:32,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 695c2e71 >2014-01-30 08:49:32,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 695c2e71 >2014-01-30 08:49:32,515 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d753c9 >2014-01-30 08:49:32,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@33443541, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75a13972}, log id: 1d753c9 >2014-01-30 08:49:37,810 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5cb7e1f8 >2014-01-30 08:49:38,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5cb7e1f8 >2014-01-30 08:49:38,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4daaadd0 >2014-01-30 08:49:38,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c97b2730, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc749789}, log id: 4daaadd0 >2014-01-30 08:49:43,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d976c56 >2014-01-30 08:49:44,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: d976c56 >2014-01-30 08:49:44,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5042eccd >2014-01-30 08:49:44,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@da20dae, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f8a4738}, log id: 5042eccd >2014-01-30 08:49:49,406 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 24ed0077 >2014-01-30 08:49:49,897 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 24ed0077 >2014-01-30 08:49:49,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8f7e9ae >2014-01-30 08:49:50,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bc02e27, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d218a29}, log id: 8f7e9ae >2014-01-30 08:49:55,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31bb2646 >2014-01-30 08:49:55,385 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-22) [6f443883] No up server in cluster >2014-01-30 08:49:55,386 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-22) [6f443883] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:49:55,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 457e76a5 >2014-01-30 08:49:55,641 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterTasksListVDSCommand, return: [], log id: 457e76a5 >2014-01-30 08:49:55,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 31bb2646 >2014-01-30 08:49:55,734 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 155a455a >2014-01-30 08:49:56,010 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4830b6e6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5eafd7a8}, log id: 155a455a >2014-01-30 08:50:01,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7816a330 >2014-01-30 08:50:01,537 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7816a330 >2014-01-30 08:50:01,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 511f85b >2014-01-30 08:50:01,823 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3f8b5f8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0c1994e}, log id: 511f85b >2014-01-30 08:50:06,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41445d07 >2014-01-30 08:50:07,351 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 41445d07 >2014-01-30 08:50:07,361 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 593d82c >2014-01-30 08:50:07,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9ac6809a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24462e3c}, log id: 593d82c >2014-01-30 08:50:12,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 757f4fc9 >2014-01-30 08:50:13,194 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 757f4fc9 >2014-01-30 08:50:13,202 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: a10cb34 >2014-01-30 08:50:13,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@146d4a55, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d78b0d14}, log id: a10cb34 >2014-01-30 08:50:18,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7fc1b35 >2014-01-30 08:50:19,013 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7fc1b35 >2014-01-30 08:50:19,021 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 51d17f09 >2014-01-30 08:50:19,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f147df0f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b47a70cd}, log id: 51d17f09 >2014-01-30 08:50:23,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 7b9512bd >2014-01-30 08:50:23,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@5108e740, log id: 7b9512bd >2014-01-30 08:50:23,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 1f864450 >2014-01-30 08:50:24,118 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@538a69b5, log id: 1f864450 >2014-01-30 08:50:24,323 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 194a9749 >2014-01-30 08:50:24,824 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 194a9749 >2014-01-30 08:50:24,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4ca19638 >2014-01-30 08:50:25,105 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fb03c53, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a973b41}, log id: 4ca19638 >2014-01-30 08:50:30,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1ba2abed >2014-01-30 08:50:30,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1ba2abed >2014-01-30 08:50:30,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7bbb25e8 >2014-01-30 08:50:30,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@514bf439, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dee8b9d1}, log id: 7bbb25e8 >2014-01-30 08:50:35,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b562752 >2014-01-30 08:50:36,418 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7b562752 >2014-01-30 08:50:36,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b565b91 >2014-01-30 08:50:36,684 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@612a224c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df527815}, log id: 6b565b91 >2014-01-30 08:50:41,707 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74ac4378 >2014-01-30 08:50:42,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 74ac4378 >2014-01-30 08:50:42,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b2ab7e0 >2014-01-30 08:50:42,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa1310da, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c4b038a}, log id: b2ab7e0 >2014-01-30 08:50:47,521 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 313bde10 >2014-01-30 08:50:48,005 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 313bde10 >2014-01-30 08:50:48,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 73c28ea0 >2014-01-30 08:50:48,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@395bd36d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@16caf15f}, log id: 73c28ea0 >2014-01-30 08:50:53,307 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32207803 >2014-01-30 08:50:53,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 32207803 >2014-01-30 08:50:53,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7df58832 >2014-01-30 08:50:54,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1ec0b894, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c485987}, log id: 7df58832 >2014-01-30 08:50:55,646 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] No up server in cluster >2014-01-30 08:50:55,647 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:50:55,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: ed8e1eb >2014-01-30 08:50:55,946 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterTasksListVDSCommand, return: [], log id: ed8e1eb >2014-01-30 08:50:59,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2507f853 >2014-01-30 08:50:59,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2507f853 >2014-01-30 08:50:59,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1570c060 >2014-01-30 08:50:59,888 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@691b95c7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@253b419c}, log id: 1570c060 >2014-01-30 08:51:04,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f6b4009 >2014-01-30 08:51:05,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1f6b4009 >2014-01-30 08:51:05,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f2bc8c9 >2014-01-30 08:51:05,708 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e72e58d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7197867}, log id: 5f2bc8c9 >2014-01-30 08:51:10,747 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 276593bc >2014-01-30 08:51:11,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 276593bc >2014-01-30 08:51:11,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e701bb7 >2014-01-30 08:51:11,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-45) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36c83fca, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7af18b6}, log id: 2e701bb7 >2014-01-30 08:51:16,558 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 661866a1 >2014-01-30 08:51:17,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 661866a1 >2014-01-30 08:51:17,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 46ecff60 >2014-01-30 08:51:17,324 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e72de2a1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d129781d}, log id: 46ecff60 >2014-01-30 08:51:22,362 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e1d01ea >2014-01-30 08:51:22,836 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4e1d01ea >2014-01-30 08:51:22,842 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 55373917 >2014-01-30 08:51:23,107 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ca7c7001, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c97b76}, log id: 55373917 >2014-01-30 08:51:28,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77dcb6cd >2014-01-30 08:51:28,637 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 77dcb6cd >2014-01-30 08:51:28,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5fe5b71f >2014-01-30 08:51:28,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ee49452a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46af7649}, log id: 5fe5b71f >2014-01-30 08:51:33,964 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: fda01d7 >2014-01-30 08:51:34,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: fda01d7 >2014-01-30 08:51:34,435 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f58e5dd >2014-01-30 08:51:34,717 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c6f32eb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94c77a80}, log id: 5f58e5dd >2014-01-30 08:51:39,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21da5bfe >2014-01-30 08:51:40,253 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 21da5bfe >2014-01-30 08:51:40,261 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41d3250f >2014-01-30 08:51:40,542 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@549a4701, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c4b6774}, log id: 41d3250f >2014-01-30 08:51:45,586 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 28d0fbb9 >2014-01-30 08:51:46,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 28d0fbb9 >2014-01-30 08:51:46,087 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4bce6365 >2014-01-30 08:51:46,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@152d8a4a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf6023f7}, log id: 4bce6365 >2014-01-30 08:51:51,402 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53316efb >2014-01-30 08:51:51,887 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 53316efb >2014-01-30 08:51:51,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d9df5cd >2014-01-30 08:51:52,166 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83b49342, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@742ccfd7}, log id: 6d9df5cd >2014-01-30 08:51:55,951 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-7) [631bc2a6] No up server in cluster >2014-01-30 08:51:55,952 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-7) [631bc2a6] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:51:55,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 77e405aa >2014-01-30 08:51:56,238 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterTasksListVDSCommand, return: [], log id: 77e405aa >2014-01-30 08:51:57,196 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 470f7229 >2014-01-30 08:51:57,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 470f7229 >2014-01-30 08:51:57,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52487b8d >2014-01-30 08:51:57,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7f268c8e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@778e07}, log id: 52487b8d >2014-01-30 08:52:03,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 245bc564 >2014-01-30 08:52:03,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 245bc564 >2014-01-30 08:52:03,512 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d860f6c >2014-01-30 08:52:03,803 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4df292a2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@17edd259}, log id: d860f6c >2014-01-30 08:52:08,845 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d1f962f >2014-01-30 08:52:09,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1d1f962f >2014-01-30 08:52:09,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29f47baf >2014-01-30 08:52:09,605 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@65942eef, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a9b60b3}, log id: 29f47baf >2014-01-30 08:52:14,643 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2cf158a8 >2014-01-30 08:52:15,126 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2cf158a8 >2014-01-30 08:52:15,133 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e017dec >2014-01-30 08:52:15,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ce036517, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d2f8e2f8}, log id: 7e017dec >2014-01-30 08:52:20,443 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 36f74eed >2014-01-30 08:52:20,923 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 36f74eed >2014-01-30 08:52:20,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ec50bb4 >2014-01-30 08:52:21,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31c065d7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c9f1e4f0}, log id: 5ec50bb4 >2014-01-30 08:52:26,235 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c6293ad >2014-01-30 08:52:26,730 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c6293ad >2014-01-30 08:52:26,736 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4a332a18 >2014-01-30 08:52:27,024 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c401d172, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7dbd649}, log id: 4a332a18 >2014-01-30 08:52:32,060 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c7b1b6d >2014-01-30 08:52:32,528 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6c7b1b6d >2014-01-30 08:52:32,535 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3fc86299 >2014-01-30 08:52:32,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fb97d5a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12ce5c1b}, log id: 3fc86299 >2014-01-30 08:52:37,828 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c00ad5 >2014-01-30 08:52:38,313 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1c00ad5 >2014-01-30 08:52:38,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3885ebf8 >2014-01-30 08:52:38,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-60) [6d9fe1a5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd1e67f4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2f6e7246}, log id: 3885ebf8 >2014-01-30 08:52:43,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54b9e77f >2014-01-30 08:52:44,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 54b9e77f >2014-01-30 08:52:44,129 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 522bf632 >2014-01-30 08:52:44,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a69ebc12, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bfc27f44}, log id: 522bf632 >2014-01-30 08:52:49,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ade9570 >2014-01-30 08:52:49,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2ade9570 >2014-01-30 08:52:49,932 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15bce432 >2014-01-30 08:52:50,200 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a07ee820, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@698921f0}, log id: 15bce432 >2014-01-30 08:52:55,242 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17a4af61 >2014-01-30 08:52:55,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 17a4af61 >2014-01-30 08:52:55,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 19a2b64e >2014-01-30 08:52:55,978 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb03134c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69f98a1c}, log id: 19a2b64e >2014-01-30 08:52:56,242 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-19) [7a87389a] No up server in cluster >2014-01-30 08:52:56,242 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-19) [7a87389a] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:52:56,246 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4049e2a2 >2014-01-30 08:52:56,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-19) [7a87389a] FINISH, GlusterTasksListVDSCommand, return: [], log id: 4049e2a2 >2014-01-30 08:53:01,003 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 771c0285 >2014-01-30 08:53:01,487 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 771c0285 >2014-01-30 08:53:01,494 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1fe7e581 >2014-01-30 08:53:01,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b4f034fb, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5f22f1e}, log id: 1fe7e581 >2014-01-30 08:53:06,786 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a5ef270 >2014-01-30 08:53:07,298 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3a5ef270 >2014-01-30 08:53:07,305 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2906953c >2014-01-30 08:53:07,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-10) [641a6d1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b301a687, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3ae6afc4}, log id: 2906953c >2014-01-30 08:53:12,610 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c344254 >2014-01-30 08:53:13,093 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2c344254 >2014-01-30 08:53:13,098 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d1bc984 >2014-01-30 08:53:13,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@440ee5f8, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c403357}, log id: d1bc984 >2014-01-30 08:53:18,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d6b621b >2014-01-30 08:53:18,893 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1d6b621b >2014-01-30 08:53:18,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77141e0d >2014-01-30 08:53:19,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e1ea40bf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9bf0cbf3}, log id: 77141e0d >2014-01-30 08:53:24,209 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48f595ce >2014-01-30 08:53:24,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 48f595ce >2014-01-30 08:53:24,691 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5e589884 >2014-01-30 08:53:24,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-80) [992a9f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@95977624, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f3e0752b}, log id: 5e589884 >2014-01-30 08:53:29,993 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2f2ec104 >2014-01-30 08:53:30,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2f2ec104 >2014-01-30 08:53:30,496 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 13e022b7 >2014-01-30 08:53:30,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bbc16a71, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@462186e8}, log id: 13e022b7 >2014-01-30 08:53:35,784 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7fe613d7 >2014-01-30 08:53:36,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7fe613d7 >2014-01-30 08:53:36,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 286367a1 >2014-01-30 08:53:36,540 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f41680bf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@540b483b}, log id: 286367a1 >2014-01-30 08:53:41,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48d11585 >2014-01-30 08:53:42,053 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 48d11585 >2014-01-30 08:53:42,061 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4eafba75 >2014-01-30 08:53:42,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-53) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@73256388, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@27c291f8}, log id: 4eafba75 >2014-01-30 08:53:47,383 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 63671ef0 >2014-01-30 08:53:47,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 63671ef0 >2014-01-30 08:53:47,867 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 331204dc >2014-01-30 08:53:48,144 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e52e070, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2ecd7706}, log id: 331204dc >2014-01-30 08:53:53,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f152c0b >2014-01-30 08:53:53,667 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7f152c0b >2014-01-30 08:53:53,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60cbfee5 >2014-01-30 08:53:53,941 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d9065886, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2cec3b7}, log id: 60cbfee5 >2014-01-30 08:53:56,520 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-76) [5b01de2c] No up server in cluster >2014-01-30 08:53:56,520 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-76) [5b01de2c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:53:56,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: ad685bd >2014-01-30 08:53:56,805 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterTasksListVDSCommand, return: [], log id: ad685bd >2014-01-30 08:53:58,980 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ce4b91b >2014-01-30 08:53:59,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3ce4b91b >2014-01-30 08:53:59,471 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 73147cfd >2014-01-30 08:53:59,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9a6c3786, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@edb3e5a1}, log id: 73147cfd >2014-01-30 08:54:04,790 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 270d1f28 >2014-01-30 08:54:05,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 270d1f28 >2014-01-30 08:54:05,280 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22aa9977 >2014-01-30 08:54:05,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-32) [18099453] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2095cd9d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bdd66ad6}, log id: 22aa9977 >2014-01-30 08:54:10,591 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f9d25fe >2014-01-30 08:54:11,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4f9d25fe >2014-01-30 08:54:11,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68510165 >2014-01-30 08:54:11,330 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@64b2c13c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e9659f9a}, log id: 68510165 >2014-01-30 08:54:16,356 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 17726548 >2014-01-30 08:54:16,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 17726548 >2014-01-30 08:54:16,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e23885a >2014-01-30 08:54:17,135 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa3be4b1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b8e838b0}, log id: 1e23885a >2014-01-30 08:54:22,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7c607780 >2014-01-30 08:54:22,669 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7c607780 >2014-01-30 08:54:22,675 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 155e0026 >2014-01-30 08:54:22,942 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-37) [2a3b7700] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f34d4bbd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a1867683}, log id: 155e0026 >2014-01-30 08:54:27,988 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 546050ab >2014-01-30 08:54:28,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 546050ab >2014-01-30 08:54:28,490 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1eabcd58 >2014-01-30 08:54:28,758 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c81d0e83, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de407ea0}, log id: 1eabcd58 >2014-01-30 08:54:33,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f183e14 >2014-01-30 08:54:34,274 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7f183e14 >2014-01-30 08:54:34,281 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a65f7c1 >2014-01-30 08:54:34,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b1c568d5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3343c567}, log id: 2a65f7c1 >2014-01-30 08:54:39,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 261d920d >2014-01-30 08:54:40,066 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 261d920d >2014-01-30 08:54:40,073 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c663eda >2014-01-30 08:54:40,353 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@11d1c15d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@10a0508a}, log id: 3c663eda >2014-01-30 08:54:45,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48b4fbae >2014-01-30 08:54:45,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 48b4fbae >2014-01-30 08:54:45,871 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d9ef24b >2014-01-30 08:54:46,146 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fb0a893, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d1ddbbc1}, log id: 3d9ef24b >2014-01-30 08:54:51,181 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58c7d536 >2014-01-30 08:54:51,659 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 58c7d536 >2014-01-30 08:54:51,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ac6682f >2014-01-30 08:54:51,927 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-17) [b80ce35] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d1d4ea, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46595be0}, log id: ac6682f >2014-01-30 08:54:56,812 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-73) No up server in cluster >2014-01-30 08:54:56,812 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-73) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:54:56,818 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 5ff0855e >2014-01-30 08:54:56,956 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3528ad2c >2014-01-30 08:54:57,092 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterTasksListVDSCommand, return: [], log id: 5ff0855e >2014-01-30 08:54:57,465 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3528ad2c >2014-01-30 08:54:57,473 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1220e7e7 >2014-01-30 08:54:57,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d635b6c5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6164257}, log id: 1220e7e7 >2014-01-30 08:55:02,783 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4519fa9c >2014-01-30 08:55:03,273 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4519fa9c >2014-01-30 08:55:03,278 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2efd467c >2014-01-30 08:55:03,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-23) [2517ed6c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3b69e376, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4a7eebf7}, log id: 2efd467c >2014-01-30 08:55:08,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 33176c8 >2014-01-30 08:55:09,064 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 33176c8 >2014-01-30 08:55:09,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 75095af7 >2014-01-30 08:55:09,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-71) [1ac2212e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9578dc75, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14763ee8}, log id: 75095af7 >2014-01-30 08:55:14,369 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72f051bb >2014-01-30 08:55:14,846 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 72f051bb >2014-01-30 08:55:14,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37ecd351 >2014-01-30 08:55:15,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@36f2c9ec, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2e2e401}, log id: 37ecd351 >2014-01-30 08:55:20,155 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3b8519ca >2014-01-30 08:55:20,656 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3b8519ca >2014-01-30 08:55:20,664 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 647c5284 >2014-01-30 08:55:20,930 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@af1c6e1d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6e34bbda}, log id: 647c5284 >2014-01-30 08:55:24,145 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 30b4fab7 >2014-01-30 08:55:24,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@18ce4b84, log id: 30b4fab7 >2014-01-30 08:55:24,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: fbfd3d5 >2014-01-30 08:55:24,695 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@57cce02c, log id: fbfd3d5 >2014-01-30 08:55:25,967 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66559a13 >2014-01-30 08:55:26,464 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 66559a13 >2014-01-30 08:55:26,470 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69f0dea >2014-01-30 08:55:26,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@577adeb1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4ae6844f}, log id: 69f0dea >2014-01-30 08:55:31,801 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c55256c >2014-01-30 08:55:32,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5c55256c >2014-01-30 08:55:32,295 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71d375a3 >2014-01-30 08:55:32,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9040e3b9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c82294b8}, log id: 71d375a3 >2014-01-30 08:55:37,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6b8fbf10 >2014-01-30 08:55:38,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6b8fbf10 >2014-01-30 08:55:38,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1fb41e1e >2014-01-30 08:55:38,394 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@293416b3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3ec7c3e}, log id: 1fb41e1e >2014-01-30 08:55:43,437 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1db1cca3 >2014-01-30 08:55:43,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1db1cca3 >2014-01-30 08:55:43,919 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 18600cb5 >2014-01-30 08:55:44,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-87) [6fd19374] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@484729c3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@530af636}, log id: 18600cb5 >2014-01-30 08:55:49,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1fc7d67b >2014-01-30 08:55:49,697 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1fc7d67b >2014-01-30 08:55:49,702 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2a9e8dc3 >2014-01-30 08:55:49,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab74dd61, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@267264bf}, log id: 2a9e8dc3 >2014-01-30 08:55:55,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 20006312 >2014-01-30 08:55:55,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 20006312 >2014-01-30 08:55:55,500 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1169527 >2014-01-30 08:55:55,769 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@428ff07b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@df139c1a}, log id: 1169527 >2014-01-30 08:55:57,097 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-36) [359e3b48] No up server in cluster >2014-01-30 08:55:57,097 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-36) [359e3b48] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:55:57,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 3fb98139 >2014-01-30 08:55:57,381 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterTasksListVDSCommand, return: [], log id: 3fb98139 >2014-01-30 08:56:00,806 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 61e15205 >2014-01-30 08:56:01,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 61e15205 >2014-01-30 08:56:01,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 118bd44c >2014-01-30 08:56:01,555 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-84) [2ccca513] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e3478516, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3767e1ae}, log id: 118bd44c >2014-01-30 08:56:06,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7489d0d4 >2014-01-30 08:56:07,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7489d0d4 >2014-01-30 08:56:07,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31155e0d >2014-01-30 08:56:07,380 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1c2e0d53, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f51d5c0b}, log id: 31155e0d >2014-01-30 08:56:12,417 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6fd1c3a6 >2014-01-30 08:56:12,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6fd1c3a6 >2014-01-30 08:56:12,904 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 720b7b53 >2014-01-30 08:56:13,177 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a95aaa47, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5ff66a12}, log id: 720b7b53 >2014-01-30 08:56:18,204 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 34f3ff3a >2014-01-30 08:56:18,672 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 34f3ff3a >2014-01-30 08:56:18,679 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ddf674d >2014-01-30 08:56:18,947 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35c64b64, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12ab8a78}, log id: 2ddf674d >2014-01-30 08:56:23,989 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3254611 >2014-01-30 08:56:24,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3254611 >2014-01-30 08:56:24,482 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 71aba371 >2014-01-30 08:56:24,760 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d7d0f25d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@472c8e2f}, log id: 71aba371 >2014-01-30 08:56:29,799 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c6f61d2 >2014-01-30 08:56:30,283 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: c6f61d2 >2014-01-30 08:56:30,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2894fe20 >2014-01-30 08:56:30,566 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d963f3f6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@157698a5}, log id: 2894fe20 >2014-01-30 08:56:35,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1958e6ff >2014-01-30 08:56:36,114 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1958e6ff >2014-01-30 08:56:36,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 686cf3fb >2014-01-30 08:56:36,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-73) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dd3e0415, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf91eccb}, log id: 686cf3fb >2014-01-30 08:56:41,455 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5df87e88 >2014-01-30 08:56:41,936 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5df87e88 >2014-01-30 08:56:41,943 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6faeeab6 >2014-01-30 08:56:42,230 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fa7e9246, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@297e41fe}, log id: 6faeeab6 >2014-01-30 08:56:47,270 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ee58af0 >2014-01-30 08:56:47,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3ee58af0 >2014-01-30 08:56:47,779 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76041613 >2014-01-30 08:56:48,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@67b23689, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@39cf2c33}, log id: 76041613 >2014-01-30 08:56:53,099 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37e1a0f1 >2014-01-30 08:56:53,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 37e1a0f1 >2014-01-30 08:56:53,619 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 422c4d76 >2014-01-30 08:56:53,892 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-7) [631bc2a6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ed314eef, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4120259c}, log id: 422c4d76 >2014-01-30 08:56:57,387 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] No up server in cluster >2014-01-30 08:56:57,388 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:56:57,393 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4c37325 >2014-01-30 08:56:57,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-78) [1b4ca6ef] FINISH, GlusterTasksListVDSCommand, return: [], log id: 4c37325 >2014-01-30 08:56:58,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1d7e3c4d >2014-01-30 08:56:59,425 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1d7e3c4d >2014-01-30 08:56:59,433 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: b0ba008 >2014-01-30 08:56:59,711 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-66) [62e25ce] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@53b85376, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b22ef035}, log id: b0ba008 >2014-01-30 08:57:04,755 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b844caf >2014-01-30 08:57:05,244 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b844caf >2014-01-30 08:57:05,251 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6351db4c >2014-01-30 08:57:05,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-57) [4166d263] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a799f591, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@793e2fd8}, log id: 6351db4c >2014-01-30 08:57:10,550 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 447360e0 >2014-01-30 08:57:11,033 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 447360e0 >2014-01-30 08:57:11,040 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 322ae1cf >2014-01-30 08:57:11,311 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fd7501d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@35c77d01}, log id: 322ae1cf >2014-01-30 08:57:16,352 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 747c13ca >2014-01-30 08:57:16,844 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 747c13ca >2014-01-30 08:57:16,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 34318d00 >2014-01-30 08:57:17,131 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-35) [1f17c565] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9dfb0344, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9296d087}, log id: 34318d00 >2014-01-30 08:57:22,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 427a0e70 >2014-01-30 08:57:22,677 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 427a0e70 >2014-01-30 08:57:22,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5783cc51 >2014-01-30 08:57:22,963 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@997e16b7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fd2a1da4}, log id: 5783cc51 >2014-01-30 08:57:28,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a55f556 >2014-01-30 08:57:28,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1a55f556 >2014-01-30 08:57:28,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 664ff3da >2014-01-30 08:57:28,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cd0055a0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71f2c2c8}, log id: 664ff3da >2014-01-30 08:57:33,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74150193 >2014-01-30 08:57:34,285 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 74150193 >2014-01-30 08:57:34,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a16df62 >2014-01-30 08:57:34,573 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-1) [6b51df7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@21fbe6b4, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@dfe845cb}, log id: 5a16df62 >2014-01-30 08:57:39,612 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4739df4c >2014-01-30 08:57:40,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4739df4c >2014-01-30 08:57:40,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 371f9c17 >2014-01-30 08:57:40,391 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@464ee1b6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@48ea71e8}, log id: 371f9c17 >2014-01-30 08:57:45,430 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4939c00a >2014-01-30 08:57:45,913 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4939c00a >2014-01-30 08:57:45,920 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3e630deb >2014-01-30 08:57:46,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@cbcd404b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f7262348}, log id: 3e630deb >2014-01-30 08:57:51,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5b5ff5e4 >2014-01-30 08:57:51,725 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5b5ff5e4 >2014-01-30 08:57:51,732 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 152f49a8 >2014-01-30 08:57:51,991 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-99) [63a33dd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7fcf4a79, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@efb95931}, log id: 152f49a8 >2014-01-30 08:57:57,019 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 59e97a7f >2014-01-30 08:57:57,507 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 59e97a7f >2014-01-30 08:57:57,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7df9c8c5 >2014-01-30 08:57:57,671 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-42) [cab85f1] No up server in cluster >2014-01-30 08:57:57,672 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-42) [cab85f1] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:57:57,678 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 120e6484 >2014-01-30 08:57:57,776 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-77) [7c43042] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7d514ffc, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@303ba0f6}, log id: 7df9c8c5 >2014-01-30 08:57:57,958 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-42) [cab85f1] FINISH, GlusterTasksListVDSCommand, return: [], log id: 120e6484 >2014-01-30 08:58:02,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12f9c8a7 >2014-01-30 08:58:03,314 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 12f9c8a7 >2014-01-30 08:58:03,322 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5a2ab295 >2014-01-30 08:58:03,594 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac017a67, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a4a71239}, log id: 5a2ab295 >2014-01-30 08:58:08,613 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 72e94229 >2014-01-30 08:58:09,113 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 72e94229 >2014-01-30 08:58:09,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e9b7c34 >2014-01-30 08:58:09,398 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-24) [3310e3f9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c31196f7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79a1c21d}, log id: 6e9b7c34 >2014-01-30 08:58:14,439 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 32dce449 >2014-01-30 08:58:14,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 32dce449 >2014-01-30 08:58:14,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d895582 >2014-01-30 08:58:15,208 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-58) [5c017a7a] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4eed6262, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fb42698e}, log id: 7d895582 >2014-01-30 08:58:20,247 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c1b898f >2014-01-30 08:58:20,756 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2c1b898f >2014-01-30 08:58:20,763 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 543cd479 >2014-01-30 08:58:21,046 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e6352dc9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4654962b}, log id: 543cd479 >2014-01-30 08:58:26,077 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 358d30d6 >2014-01-30 08:58:26,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 358d30d6 >2014-01-30 08:58:26,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6962482a >2014-01-30 08:58:26,852 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-41) [7dd1ae3e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b0d887e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b664601}, log id: 6962482a >2014-01-30 08:58:31,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 77101ad8 >2014-01-30 08:58:32,365 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 77101ad8 >2014-01-30 08:58:32,371 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27eb43a8 >2014-01-30 08:58:32,657 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@85c0f60f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1293c614}, log id: 27eb43a8 >2014-01-30 08:58:37,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a6bcbb4 >2014-01-30 08:58:38,162 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1a6bcbb4 >2014-01-30 08:58:38,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 341969ce >2014-01-30 08:58:38,436 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-16) [2c713cf8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9e951e9c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8ff0c934}, log id: 341969ce >2014-01-30 08:58:43,480 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d88c763 >2014-01-30 08:58:43,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2d88c763 >2014-01-30 08:58:43,986 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 606b00e4 >2014-01-30 08:58:44,254 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-54) [2214a5ea] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4f03c59c, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e7546e96}, log id: 606b00e4 >2014-01-30 08:58:49,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31910fda >2014-01-30 08:58:49,774 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 31910fda >2014-01-30 08:58:49,780 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 348b14d8 >2014-01-30 08:58:50,045 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@db2fc454, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5fedacfc}, log id: 348b14d8 >2014-01-30 08:58:55,068 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e310e9f >2014-01-30 08:58:55,553 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7e310e9f >2014-01-30 08:58:55,561 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1eea35d1 >2014-01-30 08:58:55,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-62) [1449451c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e45655, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@69cf20b6}, log id: 1eea35d1 >2014-01-30 08:58:57,965 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-93) [24fadd7c] No up server in cluster >2014-01-30 08:58:57,965 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-93) [24fadd7c] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:58:57,970 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 19c63fd2 >2014-01-30 08:58:58,265 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-93) [24fadd7c] FINISH, GlusterTasksListVDSCommand, return: [], log id: 19c63fd2 >2014-01-30 08:59:00,853 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6078a93f >2014-01-30 08:59:01,328 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6078a93f >2014-01-30 08:59:01,334 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31e2af18 >2014-01-30 08:59:01,603 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b75d2b38, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f19666cd}, log id: 31e2af18 >2014-01-30 08:59:06,650 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64d343b6 >2014-01-30 08:59:07,125 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 64d343b6 >2014-01-30 08:59:07,132 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5038d29 >2014-01-30 08:59:07,400 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-91) [51ec2212] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f89ef862, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eb843201}, log id: 5038d29 >2014-01-30 08:59:12,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 743a4f4 >2014-01-30 08:59:12,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 743a4f4 >2014-01-30 08:59:12,933 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 370397d >2014-01-30 08:59:13,195 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6674b70e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ffd180f}, log id: 370397d >2014-01-30 08:59:18,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 691e4c05 >2014-01-30 08:59:18,718 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 691e4c05 >2014-01-30 08:59:18,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 9a2896 >2014-01-30 08:59:19,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7c86a6bf, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c36083cc}, log id: 9a2896 >2014-01-30 08:59:24,037 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 414f3bcd >2014-01-30 08:59:24,532 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 414f3bcd >2014-01-30 08:59:24,538 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4e87862c >2014-01-30 08:59:24,812 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-5) [5cab3cac] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@30920a51, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@eac59c97}, log id: 4e87862c >2014-01-30 08:59:29,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78ddccaf >2014-01-30 08:59:30,349 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 78ddccaf >2014-01-30 08:59:30,358 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21a63e19 >2014-01-30 08:59:30,635 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f33f6d99, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@31e008be}, log id: 21a63e19 >2014-01-30 08:59:35,676 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c309d1 >2014-01-30 08:59:36,164 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1c309d1 >2014-01-30 08:59:36,172 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6c74a683 >2014-01-30 08:59:36,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-86) [63ec361] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c04e2469, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6cd27f5}, log id: 6c74a683 >2014-01-30 08:59:41,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1707beb1 >2014-01-30 08:59:41,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1707beb1 >2014-01-30 08:59:41,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 429061b >2014-01-30 08:59:42,249 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-44) [221fed7d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29be6419, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b7312af8}, log id: 429061b >2014-01-30 08:59:47,293 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 653c5cbe >2014-01-30 08:59:47,772 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 653c5cbe >2014-01-30 08:59:47,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7d660757 >2014-01-30 08:59:48,058 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9a6429f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a3dde3f7}, log id: 7d660757 >2014-01-30 08:59:53,097 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1656cd90 >2014-01-30 08:59:53,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1656cd90 >2014-01-30 08:59:53,583 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7b332290 >2014-01-30 08:59:53,855 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@72d4a1a5, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d46aad4a}, log id: 7b332290 >2014-01-30 08:59:58,272 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] No up server in cluster >2014-01-30 08:59:58,272 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 08:59:58,276 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 117fc04 >2014-01-30 08:59:58,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterTasksListVDSCommand, return: [], log id: 117fc04 >2014-01-30 08:59:58,903 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5609de65 >2014-01-30 08:59:59,404 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5609de65 >2014-01-30 08:59:59,412 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2ef87c62 >2014-01-30 08:59:59,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14bd3d03, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6dd04a3d}, log id: 2ef87c62 >2014-01-30 09:00:04,727 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c3c4545 >2014-01-30 09:00:05,213 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2c3c4545 >2014-01-30 09:00:05,219 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12d60e33 >2014-01-30 09:00:05,489 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-36) [359e3b48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b2368ea1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14af53e6}, log id: 12d60e33 >2014-01-30 09:00:10,527 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3a1406cc >2014-01-30 09:00:11,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3a1406cc >2014-01-30 09:00:11,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 78347013 >2014-01-30 09:00:11,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-74) [61851da7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9530359, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2d06c40f}, log id: 78347013 >2014-01-30 09:00:16,332 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 115e24cb >2014-01-30 09:00:16,826 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 115e24cb >2014-01-30 09:00:16,834 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2bc5f0d6 >2014-01-30 09:00:17,088 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-18) [68161e48] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b0c8dd26, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@23f08a16}, log id: 2bc5f0d6 >2014-01-30 09:00:22,123 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ad3264b >2014-01-30 09:00:22,614 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: ad3264b >2014-01-30 09:00:22,622 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2e949cb0 >2014-01-30 09:00:22,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-65) [227486be] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@50116582, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b48e44dd}, log id: 2e949cb0 >2014-01-30 09:00:24,722 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 415e32a7 >2014-01-30 09:00:24,996 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@2b918c44, log id: 415e32a7 >2014-01-30 09:00:24,998 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 608fdab4 >2014-01-30 09:00:25,263 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-85) [4376cca4] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@34baadd4, log id: 608fdab4 >2014-01-30 09:00:27,918 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 74bea0b5 >2014-01-30 09:00:28,390 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 74bea0b5 >2014-01-30 09:00:28,395 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 232d690a >2014-01-30 09:00:28,666 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-47) [2296644d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2fc6064d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0ae09fa}, log id: 232d690a >2014-01-30 09:00:33,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22e6b8b0 >2014-01-30 09:00:34,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 22e6b8b0 >2014-01-30 09:00:34,198 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 67b8e4a9 >2014-01-30 09:00:34,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ddaf6e70, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9fbffe84}, log id: 67b8e4a9 >2014-01-30 09:00:39,506 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 358606de >2014-01-30 09:00:39,994 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 358606de >2014-01-30 09:00:40,001 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 778dbcd4 >2014-01-30 09:00:40,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-28) [3472ce94] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1cc6ff43, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7e2f35f9}, log id: 778dbcd4 >2014-01-30 09:00:45,304 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 391995bb >2014-01-30 09:00:45,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 391995bb >2014-01-30 09:00:45,809 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6203f466 >2014-01-30 09:00:46,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-79) [13f3a4aa] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@71478189, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ade07519}, log id: 6203f466 >2014-01-30 09:00:51,119 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6815f25f >2014-01-30 09:00:51,593 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6815f25f >2014-01-30 09:00:51,598 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48782311 >2014-01-30 09:00:51,861 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-38) [478fa91d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a9219b99, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@506e858c}, log id: 48782311 >2014-01-30 09:00:56,902 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ef1580d >2014-01-30 09:00:57,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3ef1580d >2014-01-30 09:00:57,392 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 40fed2c0 >2014-01-30 09:00:57,654 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-55) [78fb20d6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@831b2891, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a90302d5}, log id: 40fed2c0 >2014-01-30 09:00:58,581 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-39) No up server in cluster >2014-01-30 09:00:58,581 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-39) Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 09:00:58,584 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: 59e0b434 >2014-01-30 09:00:58,865 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-39) FINISH, GlusterTasksListVDSCommand, return: [], log id: 59e0b434 >2014-01-30 09:01:02,698 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c7c799f >2014-01-30 09:01:03,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3c7c799f >2014-01-30 09:01:03,180 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2604053c >2014-01-30 09:01:03,450 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2c7c276b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b81b4a05}, log id: 2604053c >2014-01-30 09:01:08,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f6f8a10 >2014-01-30 09:01:08,966 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5f6f8a10 >2014-01-30 09:01:08,973 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2d0d6301 >2014-01-30 09:01:09,243 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-43) [871abb5] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@82c7072d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80526e23}, log id: 2d0d6301 >2014-01-30 09:01:14,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 11b1cd0 >2014-01-30 09:01:14,754 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 11b1cd0 >2014-01-30 09:01:14,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5c74336c >2014-01-30 09:01:15,023 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8b82702, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@785d57b3}, log id: 5c74336c >2014-01-30 09:01:20,069 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b7745c2 >2014-01-30 09:01:20,577 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4b7745c2 >2014-01-30 09:01:20,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3d18f01b >2014-01-30 09:01:20,858 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d68833ae, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a7e8b597}, log id: 3d18f01b >2014-01-30 09:01:25,900 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14bfe03a >2014-01-30 09:01:26,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 14bfe03a >2014-01-30 09:01:26,396 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 41d359b7 >2014-01-30 09:01:26,674 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-22) [6f443883] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b714b6a3, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3dbe02d7}, log id: 41d359b7 >2014-01-30 09:01:31,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: ccff9a0 >2014-01-30 09:01:32,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: ccff9a0 >2014-01-30 09:01:32,190 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 83902a8 >2014-01-30 09:01:32,483 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ac167cea, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab29b58}, log id: 83902a8 >2014-01-30 09:01:37,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 62b77119 >2014-01-30 09:01:38,006 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 62b77119 >2014-01-30 09:01:38,012 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a7c068f >2014-01-30 09:01:38,282 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-88) [3a9a20cf] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@18312bab, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b529a360}, log id: 1a7c068f >2014-01-30 09:01:43,316 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1c96ce74 >2014-01-30 09:01:43,815 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1c96ce74 >2014-01-30 09:01:43,822 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30275b2c >2014-01-30 09:01:44,089 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-21) [3dfe147] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@14d84ef9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@776ed5e2}, log id: 30275b2c >2014-01-30 09:01:49,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1f84fca8 >2014-01-30 09:01:49,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1f84fca8 >2014-01-30 09:01:49,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3213c7d1 >2014-01-30 09:01:49,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-34) [4af86af0] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@43569a62, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@768433e8}, log id: 3213c7d1 >2014-01-30 09:01:54,916 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4799aee >2014-01-30 09:01:55,424 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4799aee >2014-01-30 09:01:55,431 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3af7edcb >2014-01-30 09:01:55,703 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2bd6eefd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4b411026}, log id: 3af7edcb >2014-01-30 09:01:58,871 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-2) [237643cb] No up server in cluster >2014-01-30 09:01:58,871 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-2) [237643cb] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 09:01:58,878 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] START, GlusterTasksListVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 22419f91 >2014-01-30 09:01:59,153 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-2) [237643cb] FINISH, GlusterTasksListVDSCommand, return: [], log id: 22419f91 >2014-01-30 09:02:00,729 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54cefc50 >2014-01-30 09:02:01,224 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 54cefc50 >2014-01-30 09:02:01,231 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6a72e1f2 >2014-01-30 09:02:01,505 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-64) [4dd3051e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e5cc179f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c9f741e}, log id: 6a72e1f2 >2014-01-30 09:02:06,548 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c5aabf1 >2014-01-30 09:02:07,043 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3c5aabf1 >2014-01-30 09:02:07,049 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4bdfdf6a >2014-01-30 09:02:07,335 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@abbdb810, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e2f558a3}, log id: 4bdfdf6a >2014-01-30 09:02:12,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7bcc4a06 >2014-01-30 09:02:12,859 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7bcc4a06 >2014-01-30 09:02:12,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53f13b0e >2014-01-30 09:02:13,142 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-72) [4ffd8a1c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@37a064db, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@40d51bc4}, log id: 53f13b0e >2014-01-30 09:02:18,184 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 37bdf3f9 >2014-01-30 09:02:18,685 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 37bdf3f9 >2014-01-30 09:02:18,692 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2df0eef5 >2014-01-30 09:02:18,979 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d5b44e88, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@55867cb8}, log id: 2df0eef5 >2014-01-30 09:02:24,016 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 47842cd5 >2014-01-30 09:02:24,513 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 47842cd5 >2014-01-30 09:02:24,519 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2272e4b9 >2014-01-30 09:02:24,795 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-15) [13272f75] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ab4445de, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c61b7769}, log id: 2272e4b9 >2014-01-30 09:02:29,838 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 60e984c7 >2014-01-30 09:02:30,336 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 60e984c7 >2014-01-30 09:02:30,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 64548df9 >2014-01-30 09:02:30,645 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@7a5b9e03, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c407cb23}, log id: 64548df9 >2014-01-30 09:02:35,689 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3abe6259 >2014-01-30 09:02:36,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3abe6259 >2014-01-30 09:02:36,176 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 52152384 >2014-01-30 09:02:36,453 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@593d7f1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@79267499}, log id: 52152384 >2014-01-30 09:02:41,499 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6ffc440c >2014-01-30 09:02:41,974 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6ffc440c >2014-01-30 09:02:41,981 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1e830954 >2014-01-30 09:02:42,256 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-50) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0a1b275, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bf1f4c8b}, log id: 1e830954 >2014-01-30 09:02:47,284 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 53ff56f6 >2014-01-30 09:02:47,785 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 53ff56f6 >2014-01-30 09:02:47,792 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58fc4af6 >2014-01-30 09:02:48,041 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-13) [2ffc3cd7] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba0a0a62, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2a6501e7}, log id: 58fc4af6 >2014-01-30 09:02:53,070 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 29038aa8 >2014-01-30 09:02:53,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 29038aa8 >2014-01-30 09:02:53,570 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 337da3bd >2014-01-30 09:02:53,850 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-68) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c8e3a20d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b16560de}, log id: 337da3bd >2014-01-30 09:02:58,894 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 15166e14 >2014-01-30 09:02:59,159 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-11) [7cc81051] No up server in cluster >2014-01-30 09:02:59,159 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-11) [7cc81051] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 09:02:59,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 30fde797 >2014-01-30 09:02:59,375 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 15166e14 >2014-01-30 09:02:59,379 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 31ae44ce >2014-01-30 09:02:59,415 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-11) [7cc81051] FINISH, GlusterTasksListVDSCommand, return: [], log id: 30fde797 >2014-01-30 09:02:59,653 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-14) [511b856] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@138aff95, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ea16a003}, log id: 31ae44ce >2014-01-30 09:03:04,694 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: d286f4c >2014-01-30 09:03:05,167 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: d286f4c >2014-01-30 09:03:05,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 334d5ed4 >2014-01-30 09:03:05,445 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-9) [23554188] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@353e451e, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2105e135}, log id: 334d5ed4 >2014-01-30 09:03:10,472 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 66f7d6c2 >2014-01-30 09:03:10,952 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 66f7d6c2 >2014-01-30 09:03:10,960 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 21a8e984 >2014-01-30 09:03:11,234 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-97) [717bad08] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3bfba3c0, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3a9c9c7b}, log id: 21a8e984 >2014-01-30 09:03:16,275 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f5d2493 >2014-01-30 09:03:16,750 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6f5d2493 >2014-01-30 09:03:16,757 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2093ac97 >2014-01-30 09:03:17,032 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-90) [c894cd9] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a040fa08, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c0cfecf}, log id: 2093ac97 >2014-01-30 09:03:22,071 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5939c9be >2014-01-30 09:03:22,549 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5939c9be >2014-01-30 09:03:22,556 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1fc81261 >2014-01-30 09:03:22,830 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6d39d59f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@741c133d}, log id: 1fc81261 >2014-01-30 09:03:27,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7167d7de >2014-01-30 09:03:28,338 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7167d7de >2014-01-30 09:03:28,344 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7605bcd9 >2014-01-30 09:03:28,609 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-8) [70a1c224] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@12bf94a9, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3e9c6a9c}, log id: 7605bcd9 >2014-01-30 09:03:33,652 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5ab94a50 >2014-01-30 09:03:34,148 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 5ab94a50 >2014-01-30 09:03:34,154 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50974a76 >2014-01-30 09:03:34,434 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-70) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6400b9de, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@77c07076}, log id: 50974a76 >2014-01-30 09:03:39,477 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 65b48057 >2014-01-30 09:03:39,954 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 65b48057 >2014-01-30 09:03:39,959 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c490c9 >2014-01-30 09:03:40,225 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@80835c2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8de82db1}, log id: 3c490c9 >2014-01-30 09:03:45,257 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 69042915 >2014-01-30 09:03:45,744 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 69042915 >2014-01-30 09:03:45,753 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 216c7358 >2014-01-30 09:03:46,031 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-46) [213c04fd] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@75f31fd7, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f5504c8}, log id: 216c7358 >2014-01-30 09:03:51,074 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27adf2eb >2014-01-30 09:03:51,564 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 27adf2eb >2014-01-30 09:03:51,572 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7ca2870d >2014-01-30 09:03:51,848 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-76) [5b01de2c] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@29817402, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@22b3443f}, log id: 7ca2870d >2014-01-30 09:03:56,890 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1a5500b1 >2014-01-30 09:03:57,367 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1a5500b1 >2014-01-30 09:03:57,374 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7f68edf5 >2014-01-30 09:03:57,642 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-69) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3c9ac817, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@83fc1134}, log id: 7f68edf5 >2014-01-30 09:03:59,421 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-40) [4cd31087] No up server in cluster >2014-01-30 09:03:59,421 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-40) [4cd31087] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 09:03:59,428 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterTasksListVDSCommand(HostName = rb_host1, HostId = b3b4550a-7532-4ce2-b35e-7df1562cafa9), log id: eed5688 >2014-01-30 09:03:59,715 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterTasksListVDSCommand, return: [], log id: eed5688 >2014-01-30 09:04:02,686 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 22a13487 >2014-01-30 09:04:03,174 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 22a13487 >2014-01-30 09:04:03,183 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4aa652bb >2014-01-30 09:04:03,457 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-82) [4eafa082] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3fd2d28b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@690a20ce}, log id: 4aa652bb >2014-01-30 09:04:08,503 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 741becef >2014-01-30 09:04:08,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 741becef >2014-01-30 09:04:08,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 28caf >2014-01-30 09:04:09,250 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@408faa50, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@926de42b}, log id: 28caf >2014-01-30 09:04:14,289 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 610be9d8 >2014-01-30 09:04:14,773 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 610be9d8 >2014-01-30 09:04:14,778 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 320c90db >2014-01-30 09:04:15,047 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-81) [5c437990] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe021fc1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ccea7492}, log id: 320c90db >2014-01-30 09:04:20,078 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6d26b96c >2014-01-30 09:04:20,574 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6d26b96c >2014-01-30 09:04:20,582 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 14632543 >2014-01-30 09:04:20,854 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@f6fbb6d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@497d3351}, log id: 14632543 >2014-01-30 09:04:25,895 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7fb5b5ba >2014-01-30 09:04:26,401 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7fb5b5ba >2014-01-30 09:04:26,408 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 76c683ea >2014-01-30 09:04:26,696 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2288b338, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8a643527}, log id: 76c683ea >2014-01-30 09:04:31,739 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1595a529 >2014-01-30 09:04:32,201 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 1595a529 >2014-01-30 09:04:32,207 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b408ccf >2014-01-30 09:04:32,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-51) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@8c570a6d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@edbb0655}, log id: 2b408ccf >2014-01-30 09:04:37,514 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4715a52c >2014-01-30 09:04:38,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 4715a52c >2014-01-30 09:04:38,035 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4b608f06 >2014-01-30 09:04:38,320 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@98198c23, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ff457559}, log id: 4b608f06 >2014-01-30 09:04:43,360 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 271107cb >2014-01-30 09:04:43,843 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 271107cb >2014-01-30 09:04:43,851 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 44c6e7c4 >2014-01-30 09:04:44,122 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@62535bbd, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@9b49ab2e}, log id: 44c6e7c4 >2014-01-30 09:04:49,159 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 62dafbb2 >2014-01-30 09:04:49,644 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 62dafbb2 >2014-01-30 09:04:49,651 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5f8c5602 >2014-01-30 09:04:49,924 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-25) [5d39b68f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4fdda792, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a663002e}, log id: 5f8c5602 >2014-01-30 09:04:54,968 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7e84a766 >2014-01-30 09:04:55,488 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7e84a766 >2014-01-30 09:04:55,493 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2c2e8979 >2014-01-30 09:04:55,770 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-59) [499ce58b] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@489af60a, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@94fb425b}, log id: 2c2e8979 >2014-01-30 09:04:59,720 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-63) [1d6d6076] No up server in cluster >2014-01-30 09:04:59,720 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-63) [1d6d6076] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 09:04:59,726 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] START, GlusterTasksListVDSCommand(HostName = rb_host4, HostId = 9ec85f51-af07-49f8-a0b5-bee6e829f37e), log id: 72c56b2 >2014-01-30 09:05:00,014 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-63) [1d6d6076] FINISH, GlusterTasksListVDSCommand, return: [], log id: 72c56b2 >2014-01-30 09:05:00,813 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6f5d42cf >2014-01-30 09:05:01,291 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 6f5d42cf >2014-01-30 09:05:01,297 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 68533d7f >2014-01-30 09:05:01,567 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-12) [690883a1] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d36c674d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@bd664f01}, log id: 68533d7f >2014-01-30 09:05:06,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 777945b3 >2014-01-30 09:05:07,094 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 777945b3 >2014-01-30 09:05:07,101 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 193bcff3 >2014-01-30 09:05:07,382 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-56) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@3f02c34d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ba75b3ba}, log id: 193bcff3 >2014-01-30 09:05:12,426 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: c3e5387 >2014-01-30 09:05:12,906 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: c3e5387 >2014-01-30 09:05:12,912 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 48b70c53 >2014-01-30 09:05:13,189 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-49) [48e5a0bb] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1dff1217, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@297c0c34}, log id: 48b70c53 >2014-01-30 09:05:18,228 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 27c56a71 >2014-01-30 09:05:18,724 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 27c56a71 >2014-01-30 09:05:18,731 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4f0f2fbc >2014-01-30 09:05:19,009 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-27) [1194a119] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@de3c9ae2, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b3218e81}, log id: 4f0f2fbc >2014-01-30 09:05:24,052 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 378f8bb4 >2014-01-30 09:05:24,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 378f8bb4 >2014-01-30 09:05:24,530 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 5865a1f0 >2014-01-30 09:05:24,782 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-4) FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@1b4d0db1, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4e0d2a57}, log id: 5865a1f0 >2014-01-30 09:05:25,288 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 2984818d >2014-01-30 09:05:25,579 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@72daa78d, log id: 2984818d >2014-01-30 09:05:25,581 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] START, GetGlusterVolumeAdvancedDetailsVDSCommand(HostName = rb_host3, HostId = 592edab9-6d36-471e-8cb4-b1243b7b100d), log id: 712e54e3 >2014-01-30 09:05:25,860 INFO [org.ovirt.engine.core.vdsbroker.gluster.GetGlusterVolumeAdvancedDetailsVDSCommand] (DefaultQuartzScheduler_Worker-83) [7bf85f46] FINISH, GetGlusterVolumeAdvancedDetailsVDSCommand, return: org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeAdvancedDetails@1443a670, log id: 712e54e3 >2014-01-30 09:05:29,821 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 50f29806 >2014-01-30 09:05:30,294 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 50f29806 >2014-01-30 09:05:30,299 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 79059953 >2014-01-30 09:05:30,562 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-98) [e73a3c6] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@672157ea, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@2801f77c}, log id: 79059953 >2014-01-30 09:05:35,590 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 54892bb0 >2014-01-30 09:05:36,072 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 54892bb0 >2014-01-30 09:05:36,079 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 6e2524cb >2014-01-30 09:05:36,346 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-61) [62f75f5f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c87ddd5f, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@46bfa968}, log id: 6e2524cb >2014-01-30 09:05:41,387 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3c08c301 >2014-01-30 09:05:41,866 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3c08c301 >2014-01-30 09:05:41,874 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 12ed224f >2014-01-30 09:05:42,137 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-94) [4a86c6ed] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@6aae7574, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a32b754b}, log id: 12ed224f >2014-01-30 09:05:47,179 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 26bf9c0a >2014-01-30 09:05:47,683 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 26bf9c0a >2014-01-30 09:05:47,690 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1032d80f >2014-01-30 09:05:47,955 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-67) [69d5f07e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@4d2a364b, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d3b9f664}, log id: 1032d80f >2014-01-30 09:05:52,975 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2414eacb >2014-01-30 09:05:53,467 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 2414eacb >2014-01-30 09:05:53,476 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 38ea8748 >2014-01-30 09:05:53,759 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-30) [88aff39] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@a75fe3c6, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@c4b53215}, log id: 38ea8748 >2014-01-30 09:05:58,798 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3ee95c6c >2014-01-30 09:05:59,287 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 3ee95c6c >2014-01-30 09:05:59,292 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 89bec0a >2014-01-30 09:05:59,569 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-96) [444c158d] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ebf0371d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@e0c0d285}, log id: 89bec0a >2014-01-30 09:06:00,020 INFO [org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService] (DefaultQuartzScheduler_Worker-33) [5049497] No up server in cluster >2014-01-30 09:06:00,020 ERROR [org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob] (DefaultQuartzScheduler_Worker-33) [5049497] Error updating tasks from CLI: org.ovirt.engine.core.common.errors.VdcBLLException: VdcBLLException: NO_UP_SERVER_FOUND (Failed with error NO_UP_SERVER_FOUND and code 7000) > at org.ovirt.engine.core.bll.gluster.tasks.GlusterTasksService.getTaskListForCluster(GlusterTasksService.java:30) [bll.jar:] > at org.ovirt.engine.core.bll.gluster.GlusterTasksSyncJob.updateGlusterAsyncTasks(GlusterTasksSyncJob.java:84) [bll.jar:] > at sun.reflect.GeneratedMethodAccessor75.invoke(Unknown Source) [:1.7.0_45] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.7.0_45] > at java.lang.reflect.Method.invoke(Method.java:606) [rt.jar:1.7.0_45] > at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) [scheduler.jar:] > at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] > at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] > >2014-01-30 09:06:00,026 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] START, GlusterTasksListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 3189a986 >2014-01-30 09:06:00,306 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand] (DefaultQuartzScheduler_Worker-33) [5049497] FINISH, GlusterTasksListVDSCommand, return: [], log id: 3189a986 >2014-01-30 09:06:04,604 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 58f13846 >2014-01-30 09:06:05,095 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 58f13846 >2014-01-30 09:06:05,103 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 2b528626 >2014-01-30 09:06:05,376 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [520212b8] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@90786891, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b6325680}, log id: 2b528626 >2014-01-30 09:06:10,416 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 487b0db7 >2014-01-30 09:06:10,899 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 487b0db7 >2014-01-30 09:06:10,908 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 1102bc50 >2014-01-30 09:06:11,191 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-48) [4e07496f] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@fe78daba, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@d4c3d221}, log id: 1102bc50 >2014-01-30 09:06:16,232 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 16bae6d8 >2014-01-30 09:06:16,714 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 16bae6d8 >2014-01-30 09:06:16,721 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 4be733ac >2014-01-30 09:06:17,002 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-92) [61402a04] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@ef048570, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@66a6192d}, log id: 4be733ac >2014-01-30 09:06:22,039 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 7489048 >2014-01-30 09:06:22,516 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 7489048 >2014-01-30 09:06:22,522 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 501245c2 >2014-01-30 09:06:22,802 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-75) [9ebfc1e] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@adfba0d, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@5b3b351b}, log id: 501245c2 >2014-01-30 09:06:27,837 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 476bb830 >2014-01-30 09:06:28,326 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 476bb830 >2014-01-30 09:06:28,333 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 8d6dbdf >2014-01-30 09:06:28,606 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-40) [4cd31087] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@24bb7aed, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@be4d0470}, log id: 8d6dbdf >2014-01-30 09:06:33,634 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterServersListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 546d3b3b >2014-01-30 09:06:34,120 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterServersListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterServersListVDSCommand, return: [10.70.37.49:CONNECTED, 10.70.37.162:CONNECTED, 10.70.37.70:CONNECTED, 10.70.37.73:CONNECTED], log id: 546d3b3b >2014-01-30 09:06:34,128 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] START, GlusterVolumesListVDSCommand(HostName = rb_host2, HostId = 4372d879-26b5-44fe-bfef-efa138092832), log id: 25b8f5ee >2014-01-30 09:06:34,405 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-100) [3a7ae2c2] FINISH, GlusterVolumesListVDSCommand, return: {478842d3-8bba-456b-9097-189a1de8012c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@b252f580, 1f4efadb-6593-4316-81a5-a21ecebcf4ad=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@450cb3a7}, log id: 25b8f5ee
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1059662
: 857421 |
858091